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Abstract 

The Individualized Early Learning Program is the produot of an 
extensive Research and Development effort. In this paper, the authors 
describe and discuss the activities carried out in conjunction with 
the program 1 s design and development, as well as field research and 
evaluation studies conducted when implementing the program. Insights 
into these program processes are also presented. The intended 
audience includes those interested in creas related to early learning, 
instructional design, eduoatiopal psychology, and teacher cduoation. 
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INDIVIDUALIZED EARLY LEARNING PROGRAM n 

Margaret C. Wang, Gaea Leinhardt, and M. Elizabeth Boston 
° " Learning Research and Development Center 

University of Pittsburgh 



The individualized Early Learning Program (IELP). developed at 
the Learning Research and Development Center (LRDC) of the University 
of Pittsburgh, is the product of a systematic plan of research and 
developaent based on a general concept of adapting instruction to 
individual differences in children. In the program, priority is given 
to teaching children in preschool and the early elementary grades the 
basic skills and concepts needed for school performance. However, the 
IELP embodies a much broader definition of curriculum than the 
traditional one of subject matter content, instructional objectives, 
and lesson sequence. Built into the program *tc additional features 
such as instructional tasks, diagnostic procedures, instruments for 
evaluating and monitoring student learning, recommendations for the 
physical design of the classroom, and a learning management system. 



Research and development work related to the IELP was initially 
carried out in collaboration with two public schools in the Pittsburgh 
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area. One of the sohools is located in a working-class neighborhood 
in a suburb south of Pittsburgh, and the other is located in an 
inner-city neighborhood near a housing project in the city of 
Pittsburgh. Subsequent field research was conducted in collaboration 
with seven school districts participating in the National Follow 
Through Program. A list of these sites and some of their 
characteristics is presented in Table 1. As the table indicates,, 
these seven school districts are located in varied geographic and 
cultural settings ranging from an isolated indiah reservation in 
Belcourt. North Dakota to an inner-city community in Akron, Ohio. 

a 

The overall purpose of this paper is to describe the process of 
progran development and field research that was carried out in order _ 
to docunent the implantation and effects of the IELP in school 
settings. Organized into four major sections, the paper: provides an 
overview of the Individualized Birly Learning Program; discusses the 
process of progran developnent; describes the field research 
activities undertaken; and discusses the. insights gained while 
developing and studying the program. All three authors have been 
actively involved in various stages of Mie program's RAD work, and 
each has contributed her unique perspective. Wang, as a developer, 
focused her work on program design, initial field testing, and 
"docunentation of progran effects. Leinhardt, a researcher *th an 
interest in field studies, conducted field research related to°progra» 
iaplaoentation in the seven Follow Through sites. Boston, as an 
implaoentor, directed the implasentatlon of the IELP in collaboration 
with the LRDC-af filiated Follow Through school sites. 
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Characteristics of llfoc Follow Through Sites 



Characteristics 



Year of entry into 
LRDC Follow Through 




Large mid-west inner city school district with two 
FT schools in the Black community 

Small northern Isolated Indian Reservation with the 
FT program in both Native American community schools, 

Large eastern county school ifirtrict serving this small- 1 
town semi-rural white community with the FT program in 
seven scattered schools. 

Small mid west white town-farm area with all three * 
schools in the district having the FT program, 

Large Appalachian county school district with three FT 
schools in a rural-valley white community. 

Medium-Sized southern city school district With FT in two 
of the mixed population urban schools. 

Medium-sized southern city school district with three FT 
schoolsin the mixed population community. 



1970-71 



1971-72 



1969-70 



1968-69 



1971-72 



1971-72 
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Overview of the Program 3 

Moat of the innovative early childhood education programa 
developed in the 1960' a were deaigned with the apecific intention of 
preparing socioeconomically diaadvantaged children for school 
learning. While thia concern waa ahared by the developera of the 
IELP, the program ia baaed on the philosophy that there are ' univeraal 
characteriatica of % developnent ahared by all children regardless of 
socioeconomic or cultural differences. The belief ia fchat children 
differ aa individuals, not as groups. The differences in individuals 
within socioeconomic or cultural groups are as great, if not greater, 
than the differences that exist across these subgroups. The IELP 
prescribes learning environments that adapt to the learning needs of 
the child and that include opportunities to optimize cognitive and 
social growth for every child. 

The 0 Individualized Early Learning Program is the product of an 
eclectic set of influences, derived from theories and research related 
to child developnent and learning as well as from selected aspects of 
instructional technology and practice..* The framework that guided 
formulation of the program philosophy and selection of the program 
content represents an integration of concepts including: (a) the 
cognitive-developmental theory of Piaget (1963);. <b> learninj theory 
in the tradition of Skinner (1971 ); and (c) knowledge and practical 
experiences gained from the research, developnent, and implementation 
of educational programa that are adaptive to individual differences in 
children, as well as from observations and work with teachers and 
children in school settings (Glaser, 1971). 
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The program design was greatly Influenced by the concept that 
eertaln abilities appear earlier than others and serve as the 
foundation upon which more complex abilities are built* The design of 
the IELP was also heavily Influenced by the notion that It Is possible 
to aooelerate oertaln aspects of the child 1 s development by focusing 
on the ao qui sit Ion . of specific prerequisite skills* It Is assumed 

that, once the developmental tasks are Identified, a child* s 

o 

development oan be Influenced In specific ways* The Identification 
and the design of learning tasks for the IELP was based, to a great 
degree, on: (a) approaches and techniques related to the positive 
modification of children 1 s learning;" (b) techniques for the 
manipulation of the learning environment; and (c) Instructional 
strategies that are effective in meeting the individual needs of the 
students in order to support and reinforce the attainment of the 
program's objectives* In this regard, the earliest formal statements 
by Re snick (1967) concerning the ongoing development of the 
Individualized Early Learning Program reflect the need for facility In 
the use of technical innovations in programmed instruction and task 
analysis, as well as a concern with the feasibility of applying new 
techniques to the program' s content. . 

The concept that the acquisition of knowledge comes about through 
a variety of learning experiences and that it proceeds at different 
rates, throughout the stages of the child's development also played a 
central role In shaping the program design of the IELP. The preschool 
child, as described by Piaget, "...is not satisfied with speaking; he 
must needs 'play out' what he thinks and symbolize his ideas by means 
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of gestures or objects, and represent things by imitation, drawing and 
^construction" (1963, p. 159). Furthermore, the rate of development 
may vary among children, as well as among different aspects of 
developoent for a particular child. Therefore, simultaneous growth on 
all fronts may not occur. An individual child's rate of growth may be 
more rapid in certain areas than in others. 

It is important to note that the purpose here is to provide a 
broad overview of the theoretical and pedagogical considerations 
underlying the development of the IELP. It is not the authors 1 
desire, nor is it feasible by design, to pinpoint which of these 
principles are direct derivatives of certain specific theoretical or 
pedagogical influences. The theoretical and pedagogical influences 
considered were interrelated by nature; the principles derived 
represent the results of the integration of all those influences. The 
following is a summary of the principles that influenced the design of 
the IELP. 



1. Children differ as individuals. They differ in learning 
rates, learning experiences, and entering competencies. 
Learning experiences should be built upon the child's 
strengths, past learning, and current abilities. 



2. Children acquire knowledge and develop skills in many ways. 
In order to adapt instruction to the individual differences 
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in children, an effective program should include a variety of 
materials and learning experiences as well as opportunities 
to use and manipulate materials Independently. 

D 

Children learn through actions. They learn partly through 
their own spontaneous activities and interactions with others 

0 

and with the environment, and partly through the materials 
and interactions adults set up for them. Careful 
consideration should be given to the creation of classroom 
learning environments which permit each child to experiment 
and evaluate what happens. Opportunities should be provided 
for children to manipulate objects, situations, and symbols; 
to pose questions and seek answers; to make choices; to 
participate in making learning plans; to take some 
responsibility for making. learning decisions and carrying out 
the learning plans; and above all, to learn from their 
mistakes and successes. 

Children should experience success in school learning. The 
use of positive reinforcement , is a powerful intervention 
strategy. Momentary difficulties in learning should not be 
viewed as the child's failure. They should be viewed as 
instructional design problems that the teacher and the 
program developer must overcome. 



7 




Children in the preschool and early elementary classrooms 
should be provided with opportunities to engage in 
spontaneous interactions with other children and adults. 
Early school learning environments provide a natural social 
context in which patterns of spontaneous interaction with 
peers and social skills are first established. Opportunities 
shoul* be created to permit children ,to work and play 
together; to exchange information and ideas; to ask and 
give help; to resolve conflicts; to form and to resolve 
friendships; and to develop social skills and patterns of 
interaction with peers and other adults that are mutually 
adaptive and satisfying.. . 

Children learn basic skills most effectively when learning 

experiences are organized sequentially. Learning experiences 

should be grouped hierarchically ,in small subsets with 

built-in checkpoints. The ability to perform more complex 

learning tasks is thus viewed as a reliable predictor of a 

student's mastery of simpler tasks, that is t those that are 

t 

lower in the learning hierarchy. 

. A childVs current competence level is the proper point at 
which to start instruction. Tto maximize the probability of 
success, mastery of each prerequisite subset of objectives 
should be required before proceeding to the next level. 

n 

I 



8. The child* 3 performance should be frequently evaluated, not 
only to make steady Increments In learning possible but also 
to serve to reinforce the child* s achievement on a regular 
basis. The development of diagnostic procedures and measures 
should be an Integral part of the program design work. They 
are critical tools which enable the teacher to accurately 
diagnose the entering behaviors of the students, to monitor 
progress, and to evaluate learning outcomes. 

The goal of the .Individualized Early Learning Program is to 
create school learning environments in which children can effectively 
master basic academic subjects while becoming confident in their own 
ability to learn and to cope with their social and physical 
surroundings. The program was designed to foster the development of: 
(a) basic skills that allow the student to locate, learn, and retain 
new information; (b> skills that allow the - student to extend and 
transfer Information to situations for solving new problems; \c) 
motivational systems. that maximize the student's situations; and (d) 
competencies that enable the student to gain increasing control over 
his or her own environment (Resnlck, 1967; Wang & Siegel, 1975). 

The, Individualized Early Learning Program Includes two basic sets 
of curricula. One is a set of highly structured prescriptive learning 
curricula aimed at teaching basic academic skills. The other is a set 
of exploratory learning curricula aimed at developing problem-solving 
and self-directed learning skills, as well as fostering personal and 
social growth. 
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Tha prescriptive learning curricula Include several 
individualized curricula developed at IRbC: Individually Prescribed 
Instruction (IPI) Mathematics (Llndvall * Bolvln. 1966); IPI Reading 
(Back & Bolvln, 1967): and the Primary Education Program (PEP), which 
consists of the Quantification Currloulua (Resnlck, Wang, * Kaplan, 
1970). the classification and Communication Skills Curriculum. (Wang, 
1972), and the Perceptual Skills Curriculum (Rosner, 1972). 
Prescriptive lesrnlng activities are generally assigned by teachers on 
the basis of diagnostic test- results and the teachers' Informal 
obssrvatlons of each student's performance. Appendix A provides 
seleotad smiles of objectives Included In the various prescriptive 
ourrioula. 

The exploratory learning curricula Include a variety of 
independent activities, centering around such Interest areas as: 
creative writing; block construction; soclo-drmatlc play; m.;slc; 
creative arts; and exploration In math, science-, and literature 
(Wang. 19730) . . Exploratory learning activities are generally 
self-selected. However, sometimes they sre jointly designed by 
students snd tesohers. 

A unique feature of the IELP Is the- Inclusion of a clsssroom 
management system, known as the Srlf-Schedule System (Wang. 1971). 
The Salf-Sohedule System was designed to serve as: (a) a classroom 
msnsgement support system to help teachers maximize their 
effectiveness In implementing the individualized Early Learning 
Prograa," and (b) an Intervention program to help students develop 



competencies In taking increasing reaponaibiiity for planning and 
carrying out their learning in school aettinga. It la a ayatem 
designed to faoilitate the effioient use of teacher inatructional time 
and, at the sane time, maximize student learning. 

During any given achool day, children in claaarooma where the 
XELP la implemented are reaponalble for oompleting all the tasks 
prescribed by the teacher and at leaat two exploratory aotlvltlea of 
their own oho ice. Both the preacriptive and the exploratory learning 
aotlvltlea are available throughout the day, and ohlldren move from 
one completed taak to another in any order they choose and at any 
time. In addition to working on individual aaaignmenta, atudenta 
participate in small group inatruotion, individual or group tutoring 
sessions, and other student- (and/or teacher-) planned or 
apontaneously developed group aotlvltlea* 

•t 

To provide the reader with a more concrete deacription of how the 
Individualized Early Learning Program operatea in clasaroom settings, 
a description of a child 1 a morning in suoh a aetting ia preaented. . A 
deliberate attempt ha a been made to focua the description on: (a) the 
nature of teacher- student interactiona (for management, aooial, and 
inatruotional purpoaea); (b) the planned and the apontaneoua 
interactiona among atudenta; and (o) the role of the teacher and 
atudenta in planning and carrying out inatruotional and learning 
responsibilities under the program. 

> 

1. Lee arrlvea at 8:25 and greeta the adulta and individual 
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children as she" gets ready to begin her learning 
for the day. 



. Lee goes to the presoription rack and takes out the 
presoription "ticket" with her name on it. She skims the 
ticket and looks around the room to see who is working on 
what, where. Lee selects one of the tasks specified on..the. 
ticket— reading—and moves to the area where the needed 
materials are stored. 



3. Lee collects a pencil and her reading workbook and goes to a 
work table. 



4. Lee opens the workbook to the page indicated and stsrts to 
work. (It is now about 8-.U5). After completing, the first 
page, she raises her hand to indicate that she is finished 
and the teacher ccmes over to her. Lee asks the teacher if 
she is doing the work correctly. The teacher reads the page 
and responds. "Yes." The teaoher briefly questions Lee on the 
content of the page, -nd disousses'the rest of the work to be 
done. The teaoher lesves and Lae continues to work. 



5." At 9:00 the teaoher snnounces thst it is time to sslute the 
flag. Lee puts down her work, stands up. and turns to fsce 



the flag for the pledge of allegiance. The teacher then 
discusses the upcoming field trip and the students 1 weekend 
plans. After a few minutes of group discussion, the teacher 
tells the students to return to work and calls a reading 
group together. It is 9:15. 

Lee returns to her reading work—reading paragraphs and 
answering questions. After completing five pages, Lee leans 
ovvr to her neighbor, Sara, and asks her how muoh more work 
she has to do before she finishes her math assignment. Lee 
then comments that she is working in the measurement unit in 
math. After a few more exchanges, she returns to her 
reading. 

At 9:40 the teacher calls Lee, Sara, Oirtis, and Scott for a 
group storyT Lee leaves her reading book, Sara leaves ner 
math sheet, and they Join the group. 

At 10:05 the teacher finishes the reading lesson, and Lee 
puts away her story, goes to get a drink of water, and visits 
with Sara at the fountain. 

At 10:10 Lee returns to her desk and continues her reading 
assignment. She finishes the last page and raises her hand. 

s. 
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While waiting for the teacher, she aska Sara which page she- a 
working on in the reading workbook and discusses the 
possibility of working on a puppet ahow project later on in 
the morning. The teacher arrive and aaka Lee to read aome. 
eight word a. checka the pagea she's been working on. and aaka 

her ^ut ^jij^.»r^^^ rta ^ ot her a0rning ' 
i^TeTthat she will do her math next and then will work 

with Sara and Scott to maU a curtain for the puppet theater. 

The teacher aaka if they are going to plan a puppet ahow aa 

well. Lee aaya, "Yea, but tommorrow." 



10 . At 10:30 Lee puta away her reading material and gets out her 
meth leaaon. She gets the yardstick, the box of materials 
that are number- and letter-coded to match her lesson, and 
her work sheet. Lee has some trouble fitting everything on 
h . r work space, and the box falls off. This creates a 
certain anount of disruption and laughter in the classroom. 
Sara bend, down and starts to put the chips and blocka up on 
the table. The aid. comes over and helps Lee get things 
organized. The yardstick goes on the floor next to Lae- s 
...t. the worksheet goes on the table, the chips and. blocks 
get laid out next to the sheet, and the box gats placed on 
the rungs under the chair. 



H. Lee starts working on her math. It is 10: i.0. She work, very 
steadily without talking or raising her hand, as she wanta to 



finish quickly; - At"-11rlO^.Ue-.raiM8 her hand . The teacher 
cones over to check off her work. Lee tells her she~will 
finish the assignment after lunch, since she wants to go work 
on the puppet stage curtain. The teacher questions Lee about 
some of the completed math work and agrees to her plans. Lee 
puts away the box of materials and the ysrfstlck but keeps 
the worksheet. 

12. At 11:15 Lae and Sara go to the exploratory area. Scott 
selects the' 'material for the curtain and Lee measures the 
front of the stage*. The teacher comes over and talks to them 
about the project and ways^to hang the curtain. Sara wants 
one that goes up and down, but the teacher thinks it will be 
hard enough ,to mala one thatvpulls to the side. Lee brings 
the material and measures to the teacher to oheck on how the 
cloth should be cut. The teacher tells them that they need 
extra material if they want folds in the curtain. The 
teacher leaves. 

13. Lee re-measures the* stage for the curtain while Scott 
straightens the material on the floor, lining it up with the 
edges of the linoleum. Lee marks the cloth with chalk where 
it needs to be out. and Sara starts to cut the material. The 
aide comes over to watch the procedure and she reminds the 
trio that the lunch period Is in five minutes and they need 
to clean up. Lee, Scott, and Sara agree %o continue their 
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project after lunch. They clean up and Join the line for 
lunoh. 3 

The*advantiiSrv)f combining . a structured • approach to direct 
teaching of basic skills and a relatively open ciaaaroom learning , .. 
environaent are reflected In the brief description of how Lee spent 
her morning. In this type of environment, children are given 
opportunities to learn to make planning declalona and to take 
increasing responsibility tor carrying out and completing their 
assigned and self-selected tasks with minimal teacher Intervention. 

Program Development 

A aystematlc approach to program development and refinement was 
adopted in Lit DC 's work on the Individual^ Early Learning Program. 
Figure 1 la a schematic representation of the Iterative nature of the 

. work Involved In developing the IELP, and the categorlea of major 
development objectives and taaks. As Indicated In the figure, program 
development begins with the development of program objeotlvea. The 
varloua program components are then built In, based on these 
objectives. The developaent work Is followed by evaluation researoh 
directed toward .the refinement of the program and the docuaentatlon of 

' program outcomes. The solid lines shown In Figure 1 indicate the 
sequential steps In the program developaent process and the dotted 
lines indicate the steps Involved In program evaluation research. 

, The three circles shown In Figure 1 represent the three major 
components of th- schooTi earning envir-o»ent • the currl.pulua. the 
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teacher, and the student. The uniqueness of the approach lies in: 

(a) the particular tasks that have been identified for inclusion in 
each of the three major components of the learning environment, and 

(b) the consideration that has been givei^to the interrelationships 
among the three components. The tasks included in the design of each 
of the components are listei'in 't^e<^ircle. The interrelationships 
among the three components and the iterative processes involved in 
designing and refining the program components are indicated by arrows 
between the circles. 

The Curriculum 

The curriculum defines the educational experiences and learning 
opportunities that are open to the individual student in working 
toward achievement of tne program objectives. The work of curriculun 
developnent includes translating program goals into specific 
curriculun objectives, designing the substantive aspects of the 
learning environment (the learning .tasks) , and designing approaches 
and classroom processes (the teaching tasks) for insuring student 
mastery of the learning tasks. 

Developnent of the various curricula included in the IELP 
generally followed the sequence outlined in the left-hand circle shown 
in Figure 1. These WD tasks reflect a broadening of the definition 
of -curriculun-. They include not only tasks traditionally associated, 
with curriculun developnent (i.e., the specification of curriculun 
objectives and the developnent of learning hierarchies, learning 
tasks, and instructional inter/ention strategies), but also strategies 
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for monitoring student learning, guidelines for the design of the 
physical environment of the claaaroom , and instructional-learning 
management ayatema to support claaaroom implementation of the varloua 



curricula. 

Fcf the purposes of illustration, the sequential atepa involved 
in the development of a beginning math curriculum, the Quantification 
Curriculum of the Individualized Early Learning Program, will be 
described below. 

The development of curriculum objectives . The Quantification 
Curriculum waa deaigned to teach baaic number operationa and concepta 
to children of preschool age through the early elementary grades. The 
deaign work began by identifying an' extended set of specific 
competencies that would ^conatitute the target behaviora for the 
program. ■» 

The initial set of obj ectives to be ihclud ed in a given 
curriculum la generally identified through a aeriea of repeated 
rational analyses. Thoae objectivea aeiected are conaidered by 
program developers as representing the knowledge and akilla critical 
to the acquiaition of certain program gcala. For example, in 
< deaigning the Quantification Curriculum, . the primary queation when 
identifying the initial aet of objectivea waa: "What are the akilla, 
and knowledge that a competent seven year eld (aecond grader) would be 
expected to have in math in order to meet the demands placed upon him 
or her by the school, parenta, and the immediate environment?" The 
reaulta of thia firat aeriea of analyses formed the baaic set of 
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desired target behavioral objectives for the curriculun. Through this 
particular process of rational analysis, eight target behaviors were 
initially identified for inclusion in the Quantification Curriculum, 
They included: counting and one-to-one correspondence from 0-5 and 
6-10, recognition of numerals 0-5 and 6-10, comparison of tets, 
seriation and ordinal positions, addition and subtraction of single 
digits, and addition and subtraction equations using single digits. 

The development of curriculum structure and learning hierarchies. 
After the target behaviors were identified, analyses of these 
behaviors were conducted in order to develop learning hierarchies that 
would lead to acquisition of the specified behaviors. Briefly, the 
strategy is to develop hierarchies of learning objectives in such a 
way that mastery of objectives lower in the hierarchy (simpler tasks) 
facilitates learning of higher objectives (more complex tasks), and 
ability to perform higher level tasks reliably predicts ability to 
perform lower level tasks. This involves a process of task and 
behavior analysis similar to that proposed and elaborated by Gagne 
(1962, 1968). Detailed procedures of analysis have been presented in 
a paper by Resnick, Wang, and Kaplan (1970). This work includes: 
explicit descriptions of the tasks to be performed as the student 
acquires the target behaviors; the cognitive processes and the 
demands placed on the student in performing these tasks; and the 
knowledge and skills required (assumed to be present in the student 1 s 
repertoire) to carry out the tasks. 

Figure 2 represents the learning hierarchy which was developed, 
using such procedures of analysis, for Unit 1 of the Quantification 
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Quantification Unit 1 - Counting and 
One- to- One Correspondence to 5 



\ 



Number ttittd (to 5) 
sets of fbced objects 



Select set of tin In- 
dicated by number 



Fixed unorde re d Mt 
of objects C to 5) 



Count objects 



Fhttd ordered sets 
of objects (to 5) 



Count objects 



Number stated (to 5) 
and e set of objects (to 5) 



Count out subset of 
stated ilte 



Set of moveable 
objects (to 5) 



Vount objects, moving 
them out of the set 
while counting. 



Recite numerals iri 
order (to 5) 



2 unequal sets of objects (to 5) 



Pair objects and state which sat has le 



H 

2 unequal sets of objects (to 5) 



Pair objects and state which set has more 



2 sets of objects (to 5) 



Pair objects and state whether the 
sets are equivalent ' 



o . - - 

Figure 2. Learning hierarchy for Unit 1 of the Quantification Curriculum.. 

Note: From the PEP Introductory Handbook, M.C. Wang and L. Resniek, (Johnstown, PA: Mafex 
Associates, Inc., 1978), p. 40. 
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Curriculum. Each box in Figure 2 defines a learning objective and the 
accompanying learning task. The entry above the line describes the 
stimulus situation, while the entry below the line describes the 
res onse. Defining each task in this fashion assures that each box in 
the hierarchy will contain a behaviorally defined task, that is, one 
that can be tested by direct observation. The simpler behaviors 
appear at the bottom of the figure. The more complex behaviors appear 
toward the top. As shown in Figure 2, Objective B is considered a 
prerequisite J both Objectives C and , E. Objective F is shown as 
having two prerequisites, Objectives D and E. 

Empirical validation of the learning hierarchies was another 
important step in the process of program development. This aspect of 
our validation work was mainly concerned with the interdependencies of 
the behaviors included within each unit of instruction, as well as the 
hierarchical order between the units (Wang, 1973b; Wang, Resnick, * 
Booxer. 1971). Empirical evidence of the interdependencies of the 
behaviors was obtained through the use of tests designed to directly 
assess the presence and absence of each of the behaviors included in a 
given learning hierarchy. The test scores were then examined to, 
determine their dependencies, that is, the extent to which passing a « 
test on one of the learning objectives reliably predicted mastery of 
all objectives below it in the sequence. 

The development of procedures for assessing and monltorln 8 
atudent nronress . Effective assessment, and 'monitoring procedures are 
considered vital to the successful implementation of an individualized, 
instructional program. The use of diagnostic pretests and posttests 
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is Integral to the instructional-learning process as ttje child 

e 

progresses through a given curriculum • Diagnostic test results are 
used by teachers not only for prescribing specific learning activities 

c 

for individual students in a given prescriptive curriculum, but also 
for communicating learning progress to students and parents. 

Upon entering a new unit in a curriculum, diagnostic tests are 
generally given to assess student entry levels. Students are 
pretested Inltlally-QiLpbjectlveCs) appearing at the top of the unit 
hierarchy, that is, the criterion objectives llicl:uded^in--eioJiJmit of 
instruction. This particular testing strategy was designed to take 
advantage of the hierarchical structure of the objectives included in 
a given unit cf instruction. Since the assumption underlying the 
development of empirically validated learning hierarchies is that 
students who pass a test at the top of a hierarchy are capable of 
passing all lower level tests, only the top objectives of the learning 
hierarchies need to be tested to quickly assess a student's level of 
competence. Students who fall the top level tests in a given 
hierarchy can then be tested, for the lower level objectives to 
determine specific instructional needs. 

Figure 3 is a sample diagnostic test sheet for Unit 1 of the 
Quantification Currictu>um, excerpted from a teacher 1 s manual (Wang & 
Resnick, 1978). The^test sheet includes a statement of the objective 
that the test was designed to assess, the testing situation, and the 
specific directions' that the teacher is to use in administering the 
test. At the bottom of each test sheet is a list of possible 
diagnoses of each child' s learning problems, should the child fail to 
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Mt ) •00MNTIN6 AW ONE-IOONE CORRESPONDENCE TO S 

toNMi ■ Pickigi "Qu«ntifte.tion 1 E" • Move*bl« ob]ecu / Crittrion- Murtpwewerytem 



TMtina SHtwtion 



TetttajDinctiOM 



14 Place ten moveable objects in front of the child. 
Put th« ob]ects back Into a pile after each response, * 

• • • 

Note: When indicating the position "here!' as you ask 
the question, allow for sufficient space to separate 
between the pile, of chips and the "here position" 
' where the child is to place the subset of objectso 
counted. ■ • . 



1, "COUNT OUT THREE OBJECTS AND PUT THEM 
OVER HERE." (point) 

2, "COUNT OUT FIVE OBJECTS AND PUT THEM 
OVER HERE." (point), 

3, "COUNT OUT TWO OBJECTS AND PUT THEM 
OVER HERE." (point) 

• , v.- 
Answers: 1. 3, 2.,^ 3. 2^ . , 



5 ' 
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Diagnosis: Child needs more yyprk in: 

1. ■ counting movable objects (Quantification Unit 1, objective B) 
t reciting numeral chain (Quantification Unit I, objective A) 

3, counting out subset of objects 

4, remembering verbal commands ' ' 1 

Fiflure3. Stmptadi^tortictHfshtetfor^ o ). 

bM^ Uohmtown« PA: Miftx AssodatM, 1978). p. 



t + 

perform satisfactorily on the; t'aiki /Specified by the objeotlve. These 
diagnoses are suggested by the task analyses results 0 and prerequisite 
behaviors Identified from the empirically validated learning.,, 
hierarchies. 

Another aspeot of the authors' researoh and development work In 
this area Involved Investigations of the use of diagnostic testing and 

the prescriptive learning approach In implementing Individualized 

% ■ 

Instruction In ' classroom settings. For example. In an observational 

> 

study designed to Investigate the^effects of diagnostic testing, the 
nature" of teacher and student behaviors associated with the tests was 
documented, as was the amount of teacher time required to administer 
and redord diagnostic test results (Wang, Resnick^ & Soheutz, 1970). 
The results of this study suggest the feasibility of adopting 
diagnostic testing as an Integral procedure in the teaching- learning 

process. The teachers participating in the study were able to 

*■ 

implement diagnostic testing as a routine classroom practice within 

' . . 

the time constraints of a school day. Furthermore, the diagnostic 
test results were, utilized . by teachers in prescribing appropriate 
learning experiences for individual students. 

> To test the hypothesis that formal ^agnostic testing -is required 
in. order to individualize instruction effectively, an investigation 
was also conducted to determine the extent to which a teacher can 
accurately assess a student's' learning progress through informal 

, interactions alone (Wang, 1973d). Every week for three .months, 
teachers were asked to predict the diagnostic test results of 
objectives in the unit in which students ware working. The 
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predictions were then compared with students' actual test results. In 
addition, teachers were given feedback on the accuracy of their 
predictions during two separate weeks to determine the extent to which 
feedback information would increase their prediction accuracy. 

The overall results of this experiment showed a wide range of 
variability in the accuracy of the teachers 1 informal observations for 
diagnosing, student learning needs. The accuracy of the teachers 1 ^ 
predictions was found to vary within and among teachers. It is also 
interesting to note that the accuracy of the predictions improved 
following each feedback session . These findings seem to support tfic 
assumption about the critical role that formal diagnostic testing 
plays in the implementation of the IELP. However, results showed that 
teachers were able to predict students' learning needs with an average 
of 74* accuracy, as opposed to an expected chance accuracy of 50*, 
suggesting that some formal testing can be replaced by teacher 
observation (Wang, 1973d). It was on the basis of results from 
experimental studies such as the ones described here, combined with 
feedback, information obtained from teachers and program evaluation 
studies carried out in. the LRDC-af filiated Follow Through sites 
(Leinhardt, 1977a&b) , that the diagnostic testing procedures for the 
individualized Early Learning Program were further developed and 
refined. 

The development of instructional intervention strategies and 
learning tasks . The learning hierarchies and the curriculum 
objectives provided the built-in guidelines for the development of 
intervention strategies and learning tasks (learning materials and 
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activities) to be included in the IELP. Drawing on the experiences of 
teachers and program developers who were Involved in the development 
and initial field testing of the Individualized Early Learning 
Program, a variety of intervention strategies and learning tasks that 
are keyed to each of the curriculum objectives were developed • They 
range from the more traditional "paper and pencil" type assignments to 
manipulative activities designed for individual and/or group use. 
Several alternative tasks for teaching each objective were developed 
to provide flexibility in "adapting learning experiences to the 
individual student. These' tasks were compiled in a number of manuals 
for teacher use (Vang & Resnick, 1978). The manuals Include detailed 
descriptions of: (a) the objective each task is designed to teach; 
(b) the learning task and the materials needed to perform the task; 
(o) procedures for carrying out the task; and (d) suggested teacher 
intervention strategies, including critical questions the teacher can 
ask the child as he or she works qn the task or when evaluating the 
student learning outcomes associated with a particular' task. 

Figure 4 is an example of the prescriptive learning tasks 
described in the Quantification Skills Curriculum Manual (Wang and 
Reanick, 1978). Each, task is labeled by a curricular code name which 
appears on the top of each page of the manual (e.g., Q1E, as shown in 
Figure 4, indicates the task is designed for Quantification Unit 1, 
Objective E). Listed on the top left-hand corner of each page under 
INVENTORY is a detailed description of the materials required for 
carrying out the learning task. On the bottom left-hand corner of 
each page under the word PROCEDURE is a description of the setting and 
procedure suggestions for the teacher. On the top right-hand corner 
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BoxQIE 



ImMoiy: 

-lesson box divided into 
-2d blocks 

• tape cassette containing lesson 

The child counts a stated number of moveable objects and 
places then) In the appropriate slot according to the taped 
directions.' - 



To the Teacher: 

1, T, checks lesson box when the child finishes tape. 
Each slot should contain the following number 
of blocks: 



•4 blocks 
TV * 2 blocks 
'Bicycle - 1 block 
Radio - 5 blocks 
Afro*pick • 2 blocks 
Telephone • 3 blocks 

I Have the child count out: 

a. three blocks 
, "b. five blocks 



Procedure: ' 

The child is seated at I table with tape recorder and cassette. 
He/she counts out the number of blocks stated on the tape, 
and planes the blocks in the appropriate slot in the lesson box. 



Questions: 

1, "How many blocks are there?" 

2. "How many blocks are thf re?" 

Correct Response: 

I "Three."' 
2. "Five." 



9 

ERIC 



Ftgur* 4. Samplt prtsaiptive fask* 
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under TO THE TEACHER are Implementation recommendations for individual 
or amall group settings. In the lower right-hand corner under 
QUESTIONS is a set of suggested questions for the teacher to use in 
determining whether; the child has acquired the particular skill. In 
addition, on the bottom right-hand section of the page is a list 
entitled CORRECT RESPONSE for the teacher's quick reference. Figure 5 
shows an example of a group exploratory learning game that can be used 
to help students acquire certain quantification skills* 

The following three broad categories* of considerations served as 
^general guidelines, for the design of the learning tasks included , in" 
the Individualized Early Learning Program* 

1. Materials should be designed, to be used by students with a 
minimum amount of teacher supervision and guidance. 
Attention is given, for example, to: the development of 
material management systems that permit easy access to the 
materials by students; the format for packaging; the 
display and storage of materials, and the format for 
communicating directions for the proper use of materials^ to 
students. 



2. Students 1 motivation for using the materials should be 
promoted and maintained in order to facilitate acquisition of 
the skills required to achieve mastery of the curriculum 
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SIZE WAR: Width 

OBJECTIVES: 1. Identify appropriate size dimension (width). 
** 2. Compare two objects by width and determine which is wider. 

3. Use the terms wider (or fatter), narrower (or skinnier), and width. 

NUMBER OF PLAYERS: 2 
MATERIALS: A. „ QwJi 



24 laminated 5" x 4 1/2" paper cards with drawings of owls in various 
colors. All owls are 4" tall. Their widths vary as follows: 

« 41/2" -*owls . ; 

31/2" -Bowls 
2.1/2" -Bowls 
1 1/2" -Bowls 

B. HiODQS 

24 laminated 5" x 4 1/2" paper cards with drawings of hippos. All hi K .os are 
4" tall. Their widths vary as follows: „ 

5" -6 hippos 
31/2" -6 hipfjos 
2" -6 hippos 
1/2" -6 hippos 

C. Uflusex 

24 laminated 6" x 4 1/2" paper cards with drawings of houses in various colors. 
All houses are 4" tall. Their widths vary as follows: 

4 1/2" N -6 houses 

3 1/2" -6 houses. 

0 2 1/2" -6 houses 

1 1/2" -6 houses 



DESCRIPTION OF THE GAME: Each child has a pile of cards. The children turn over their cards, 

one at a time, and compare them. On each turn, the child with 
the wider card is the winner. The children describe the cards using 
the term wider (fatter). 
' Figure 6. 'Sample exploratory learning ta$k. 
Not.: From ft. Unit Gtrtmof th* PEP CM^on^C^mun^tion »mOmto^n Mm* 
M.C. Wing .no L. R«nlck. (Johnrtown. PA: M.hx A»oci«t«. Inc.. 1978). p. 100. 
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objectives. This aspect of the design work focused 
&Fticx3Lj|rly^oj^ principles that are 

not* only reinforcing and stimulating t -but also pedagoglcally 
accurate and effective. Consideration Is given to the nature 
and quality of the activities and materials In terms of 
student Interests; the physical attractiveness of the 
materials; the amount of time offered to complete the task; 
the. prerequisite skills ( physical , cognitive, and social) 

A 

needed to perform the task; the developmental levels of the 
^students; feedback mechanisms to permit students and the 
teacher to evaluate the outcomes of their work; as well as 
the ease with which the materials can be handled by students 
in terms of organizing f manipulating, and putting away the 
materials. 



3. It is important to consider both the time and money Involved 
in designing and producing, the materials. As much as, 
possible, materials should be adopted that are commonly 
available commercially and/or commonly stocked in classrooms. 
The use of readily available materials and equipment provides 
the flexibility required for the implementation of an 
instructional program such . as the Individualized Early 
Learning Program. This approach will also permit and 
encourage teachers to incorporate new objectives into the 
program in order to adequately adapt learning experiences to 
the needs of their students. 

o 
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The design of the phyaleal environment of the claaarobm. 
Syatematle analyaia of how apace can beat be uaed ia an important 
concern in Implementing the IELP. Providing adequate work apace for 
children, aa well aa apace for displaying and storing materlala, ia 
net only an important practical oonaideratlon In implementing the 
program in olaaaroom aettlnga. but alao make a a great difference In 
motivating children to develop lncreaalng aelf-directlon and 
aelf-reaponalblllty for their learning. That la, the phyaleal layout 
of the olaaaroom oontrlbutea, along with the learning materlala, to 
program effectlveneaa. The rationale and dealgn of the recommended 
phyaleal layout of the olaaaroom environment haa been deaorlbed in 
detail for teachera (Wang 4 Reanlck, 1978). Briefly, In the. 
recommended olaaarcam phyaleal dealgn the arrangement of the activity 
areaa encouragea Integration. For exanple, the aocio-dramatlo play 
' area la placed .next to the conatruotlon and block area ao that 
atudenta can draw reacurcea from both areaa In their aoclo-dramatlb 
play. The aand table la . placed next to the block area ao that 
atudenta can ahare people, anlmala, and other block acceaaorlea with 
atudenta working at the sand table. Multiple uae of equlpnent la alao 
a" characterlatlc of the recommended arrangement. The bookahelvea are 
uaed aa dlvldera between the reading and llatening area and the 
dramatic play area. The backs of the bookahelvea are uaed to hang 
^dreaa-up olothea, and the baoka of the metal aupply oupboarda are uaed 
aa display apace for creative artwork. 

Figure 6 ia an exmnple of how a -traditional- firat-grade 
olaaaroom can be rearranged In order to facilitate the Implementation 
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FiQurt 6. A redesign of a "traditional" firtt-grada dauroom. 
Not»: From tha PEP introductory Handbook, M.C. Wang and L. Rasnick, Uohnrtown, PA: 
Maftx Aoodata*, Inc., 1 978), p. 1 6. 
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of the IELP. Mote that Individual daaka have been grouped together to 
encourage group activities and Interaction among children working In 
the sane activity area. Extra desks have been taken out of the room 
to provide additional floor space so that children can move about and 
work on the floor. The supplies and equipment for the language arts 
and creative arts activities are set up together to encourage 
integration of these activities. The backs of the shelves for storing 
math and exploratory learning materials^ fitted with a pegboard and 
the tools needed, for the construction area are hung on the board. The 
math " area Is set up next to the science and social studies area to 
encourage Integration of activities In these areas. 

The design of an instructional-learning management system . 
Classroom management Involves the management of curricula materials 
as well as the management of the Instructional-learning processes. 

1. jjw de^ M 1 ^ management 

of curriculum materials . The display, storage, and management of 
curricula materials is an important program design consideration for 
implementing individualized programs in classroom, settings. It Is 
important because of the wide variety of curricula* materials that 
need to be organized In a systematic way for teacher and student use. 
This is accomplished in the Individualized Early Learning Program 
' through the systematic planning and design of the physical space for 
material display and storage and through the development .of a 
materials management system that Is explicit and simple for students 
' to use and maintain. 
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Incorporated in the design of\ the program is the need to 
categorize learning materials for each objective included in each 
component of the program. Learning materials are designed in either 
of two basic formats — learning booklets or manipulative materials. 
Each booklet usually Includes an exercise to teach a single skill. 
The manipulative materials are generally packaged in small learning 
Wes, each of which contains, the materials necessary for one' 
activity. There are typically several sets of alternative learning 
materials keyed to each objective to allow flexibility and 
adaptlveness. These materials may be assigned by the teacher or 
selected by students themselves. 

To guide children 1 s use of the materials, each child is given a 
"prescription ticket",, generally at the beginning of each day. The; 
prescription ticket contains codes that match those on the learning 
materials. The child then "follows" the ticket by finding the 
booklets or boxes that ' match. Figure* 7 is an example of a 
prescription ticket for Unit 7 of the Quantification" 1 Curriculum. As 
shown in the figure, the student's assignment on Hay 14 was to 0 work on 
Objective C in Quantification Unit 7 (as circled on the prescriptive 
ticket). The student's assignments for Objective C were to work with 
number lines (task QVIIC) and play the Bingo game that was designed 
for that objective. The materials needed to complete these tasks 
would be displayed on the Quantification bookshelf in a box, labeled 
with a picture of a "duck" and the letter code (QVIIC) that matches 
the code listed on the prescription ticket.' Such labeling allows the 
student to find the necessary materials. After the task is completed, 
the teacher marks the prescription ticket accordingly. 
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Quantification Unit 7 



Kama 




Data Auigntd Oata Complttad 



&IKripjiaiajia? 



QVIIA 



GVIIB 



rfwiio? M ay 14 



GV1ID 



QVIIE 



QVIIF 



QVIIG 



Addition Pica 
Garnj 



Bear Raca 




Malta Your 
Own Baai 
Raca 



Figure 7. Sampla prescription tickat for Unit 7 of tha Quantification Skills Curriculum. 



Now From tha PEP Introductory H*>dbook,M.C. Wang and L. Resnick. (Johnstown. PA: 
Mafax Atsodatas. Inc.. 1078). p. 24. 
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Another important opnoern t with reapeot O' to classroom 
implementation of the program , la to insure that oertain areas of the 
classroom do not become so overcrowded as to prevent oonatruotlve use 
of the available materials. Teachers have used a variety of 
strategies to solve this problem. One is the use of a pagboard system 
showing eaoh activity area. A varied number of pegs are placed under 
the name of each learning area Hated on the board.' Name taga for the 
children are provided at the bottom of the pagboard. When a child 
decides to work in a given area', the child firat places . his or her 
name tag on an empty peg under the area where he or she has decided to 
work. If all of the pegs for the area are in use by other children 
tha child selects another area. There are as many pegs for eaoh area 
as tha teacher feels the area will comfortably accommodate. In this 
way, both teacher and ohildran can see at a glanoe which areas are 
free and where each child is working. 

2. The design of an Instructional- learning management system . 
The ' scheduling of student learning activities and teacher instruction 
time has been a major implementation problem for individualized 
instructional programs. .Typically, the choice is between group versus 
individual scheduling, and free choice versus teacher-prescribed 
activities. A truly effective program, however, can include all four 
alternatives for scheduling within the context of a flexible school 
day. This is accomplished in the Individualized Early Learning 
Program through the Self-Schedule System. Under the Self-Schedule 
Syatem, ohlldren can be found working in virtually every area of the 
olassroom at any given time with the teacher circulating among them. 
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tall groupe of ohlldren o.n b. called together it the dlaoretion of 
the t«aoh«r for tutorlm, t.eting, or other aotlvltlet. 

in general . data fro. atudiea reletlng to the effect, of 
Mlf-Mhedullng nuggeat that atudente and tewhera are able to uha 
■or. affective un of ..tool tto. under the Self-Schedule Syat«a. 
Children . war. ftound to ocelot, -or. t.aka in lea. ttae end «hlbit 
•ore purpoaeful and attentive behavior. The frequency of children'. 
Malting for the teeohor'a attention dropped, ohlldren worked In group 
■ettlnga -or. frequently, end ohlldren eihlblted lea, dl.agree.ent 
(1,.., fighting end arguaenta) with each other. Teaohera were 
obaarved to hav. .ore aubatantlve interaction.. Involving inatruotlon 

„* infomatlon eiohenge. a. oppoa* to ..nag-ent interaotlona that 

deal with b.n«lor or ..terl.l ..nago..nt concern,. Finally. foher. 

«lfor.ly reported . aenae of hwlng .ore time to work with end 

obeerve Individual ohlldren (Wang, 1976b). 

The Te.oher 

Work related to the dev.lop.ent of the t..oh.r oanpon.nt of the 
IELP w.a carried out with the b.aio .aaunptlon that Innovative 
•donation* practice., ownot occur without ocpetent impl-ent.tlon. 
It wa rnoognlxed that an Important ingredient in the tapl-a ntation 
of .n, innov.tiv. progr-a i. the teacher.' ability to ua. the taproved 
technique, and ..terl.la to provide effective achoollng for their 
.tudenta. Therefor., a major concern In the developaent of the 
mdlvlddlred Early Learning Progr- waa th. design of apeclflc 
i.pl«.nt.tlcn strategies and technical auppcrta for teacher. . 
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Developnent of the teacher component was concerned particularly 
with specification of teacher behaviors required In the 
Instructional-learning process and teacher competencies required in 
. preparing for effeotlve program Implementation. Ihe specific 
categories of elements included in the teacher component of the 
program are listed in the center circle in Figure 1,' Teacher 
competencies required for the instructional-learning process of the 
Individualized Early Learning Program Include both classroom 
management and instructional skills. Teacher competencies required in 
preparing for effeotlve program Implementation include designing the 
physical arrangement of the learning environment, designing and 
displaying learning and instructional materials, diagnosing student 
learning needs, monitoring student learning progress, and designing 
learning plans for individual students. 

Teachers implementing the IELP must possess the skills needed for 
both formalized "didactic" instruction and informal . instruct ion. 
Examples of didactic instructional behaviors include administering 
diagnostic tests, prescribing learning tasks, checking prescriptive 
assignments, and giving help with assignments as required. As a 
didactic instructor, the teacher also assumes the responsibility for 
large or small group tutoring sessions as dictated by the various 
curricula and by the needs of the students. However, it should be 
noted that when implementing the Individualized Early Learning Program 
informal Instructional Interactions with students are, in many oases, 
considered more important than didactio instruction. 
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Taseners fmctioning in elassroons where the IELP has been 
U«pl«.nted generally act in two «od.s~the -traveling- and the 
-tutoring- nodes. In the traveling nod., the teeoher oirouletea anong 
the students ss e rssouros person, hslping students with their 
learning tasks, oheoking. off tasks ss students oonplete the work, end 
interacting infernally tofcjmggB** or instructionsl purposes, 
ususlly for quite brief periods of tine. The tutoring node, on the 
other hand, r.quir.a the teacher to work intensively, and for longer 
period, of tine, with individuals or nasll groups of students to 
adniniatar diagnostic testa, instruct individual students, give group 
lessons, or work with a group of students on a special learning 
projeot. 

The Student 

Identifying lan.nts esscoi.ted with students and their le.rning 
process was a oentrel concern in the development of the individualized 
Early Learning Progr-. Specific el—nts that were identified ere 
list* in the circle on the right hend side of Figure 1. These 
•lea.nt. sr. ol.s.ifiod into two o.t.gories: student ohsrsoteri.tic. 
and student beh.viors associated with the le.rning process. Student 
ohsrsoteristios inolude the individu.1 student.' a sttitudes. interests, 
sot.ring eonpetenoies. snd l.ernihg style. Student .beheviors 
- ..sooistad with th. leerning process include nanagna.nt beheviors. 
learning beheviors. snd evslustion behsviors. 

The identific.tion of student characteristics snd the 
sp.oifio.tion of student behaviors in th. classroom process sr. 
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particularly unique aspects of the IELP. Characteristics of students 
and their classroom behaviors play an important role in determining 
the quality of the instruotional-learning process. LRDC'a work in 
thia area haa been concerned not only with the causal link between the 
instructional process (the teacher and the curriculum), and atudent 
learning ^outcomes but also with the causal link between the unique 
characteristics of the student and the classroom 
instruotional-learning process. In contrast to student behaviors in 
more conventional elementary classrooms, students are expected to play 
an active role in management and learning functions. To function 
effectively under the Individualized Early Learning Program, students 
need, and are taught, to acquire increased efficiency in the following 
management skills: 

** 

1. Independently managing classroom resources, materials, 
equipment, and physical space. 



2. Making appropriate choices regarding the particular learning 
activities, the time and space in which the activity is to be 
assigned, and/or whether to carry out the activity Jointly 
with peers or work alone. 

3. Requesting assistance from teachers and other students when 
it is needed for either instructional or management purposes. 
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4. Carrying out th»t planned activities within the limits of the 
classroom learning situation by observing rules and following 
directions. 



5. Giving assistance to others when it is requested. 

6. Accurately estimating the amount of time required to complete 
the planned activities and budgeting the available school 
time to complete the tasks accordingly* 



7. Delaying or stopping work on activities in order to work i 
teachers or other students on other scheduled activities. 

8. Delaying teacher attention by switching to another task u 
waiting for teacher assistance. 



9. Evaluating one's own learning progress and adjusting choices 
and schedules accordingly. 



Field Research 

Up to this point, the discussion has focused on the nature of the 
Individualired Early Learning Program and the process through which it 
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mis develops. A description of the field research conducted in the 
LRDC-aff instated Follow Through schools where the IELP hss been 
implemented is presented in this section* 

Field research conducted in the LBDC-af filiated Follow Through 
schools focused on two major areas. The first area was documentation 
of the degree of Implementation in order to describe the 
discrepancies, if any, between the program as it was designed and the 
program as it was Implemented in the Follow Through sites. The second 
area involved documentation of the programs impact on student 
learning progress. The dependent variable in the first line of 
research was the program as it' was implemented. Information was 
sought to describe how and why program changes took place. The 
dependent variable for the second line of research was student 
performance. The program, as implemented, was then the independent 
variable. 

Program Implementation 

Much of the research in the LRDC-af filiated Follow Through sites 
consisted of studies to determine the degree to which the program had 
been Implemented as it was originally designed (Leinhardt, 1972, 
1976). The purpose of this research was to monitor and assess program 
operations in order to provide continuous feedback to program 
developers and site personnel about the implementation process. 

The basic structure for research on program implementation dealt 
with input, process, and outcome variables. This research assessed 
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Initial student abilities (Input), the lnstruotlonal procedures used 
(process), end student final performance (outcome). The research was 
conducted over a four-year period (1971-1975) In a series of studies, 
each of a year's duration. The studies were conducted In the second 
grades at those LRDC-af filiated Follow Through sites where the 
second-grade progra. was operating. The type of Information collected 
in each successive year was based In part on the analysis of data fro. 
preceding years. The basic research structure remained the sane. The 
questions were franed In the context of a multiple regression 
approach. Specifically, the research sought to explain variation In 
end-of-year student achievement while considering the Impact of 
different entering abilities and different progranmatic emphases 
(Cooley A Lelnhardt, 1975; Lelnhardt. 1977b). 

Measurement and Instrumentation . Initial measurement work 
focused on the development of techniques and Instruoents for gathering 
data to asses, the degree of implementation In the various sites. Two 
type, of indentation. were used: one to reflect ,tudent knowledge 
and the other to reflect the instructional environment. 
Norm-referenced teat,, criterion-referenced tests', and Interviews were 
used to assess » tudent knowledge. The norm-referenced tests Included: 
the Lorg-Thorndike Cognitive Abilities Test (CAT) (Thorndlke. Hagan. 
A Lorge. 1968); the Metropolitan Achievement Test (MAT) (Durost. 
Bixler. Wrightston, Prescott. A Balow. 1971); Raven's Coloured 
Progressive Matrices Test (Rsven. 1956); and the Wide Rsnge 
Aehlevaaent Test (WHAT) (Jastak. Bijou. A Jastak, 1965). The 
criterion-referenced test, came from LRDC's curricula. Student 
interview, were included in the indentation developed for 
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classroom processes ssaeaement CLeinhardt, 1972). 

Over tike, e variety of Instruments were used to help assess the 
Instructional environment in LRDC's Follow Through o laser ocas. , The 
earliest Inatruaenta emerged froa the field notes of LRDC's Follow 
Through ' field staff. These field notes became the basis for 
developing more formalized procedures to document the degree of 
implementation. During IRDC's initial involvement "with Follow 
Through, Champagne (1971) developed an Informal checklist for 
documenting the presence or absence of a selected number of program 
elements. As would be expected in the early implementation of an 
innovative instructional program, these element* we'O heavily weighted 
toward equipment , expected teacher- student behaviors, and supervisory 
roles. 

Additional informal data-gathering instruments were developed to 
aid empirical researoh on the validity of the program. These 
Inatruaenta were used to identify the most significant features of the 
instructional environment. The ultimate goal was to integrate that 
information with data on student achievement. Instruments were 
designed to collect three types of information: (a) information on 
how the teacher conducted the dally activities of the classroom; (b) 
information on actual teacher behaviors, particularly the verbal 
behaviors during instruction; and (c) information on student 
behaviors and perceptions of classroom processes (Leinhardt, 1972, 
1976, 1977a, 1977b). 

All of the instruments developed were tested at local Pittsburgh 
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sites prior to use in the Follow Through classrooms. The 
observational sections of the instrunents were the easiest to 
validate-, while the sections on student academic behaviors and growth 
patterns were the most difficult. For example, while attempting to 
obtain data on students, it became evident that different sites were 
using very different approaches to record-keeping. Although standard 
record-keeping sheets were distributed. they *ere not used 
consistently. Materials such as tests. records on student 
• assignments; diagnostic test results, and other. related performance 
data were frequently not available. This situation was not due to any 
negligence on the part Of the teachers. In the early years, when the 
teachers were under pressure to implement a new instructional program 
record-keeping seemed to take a backseat, as it logically should have. 
This experience became a lesson in program implementation. That is. 
paperwork should be kept to a minimum during the introduction of a 
program. 

The reliability and validity of the observational and interview 
instruments were initially established by an in-depth study by 
Leinhardt (19T2). Inter-observer reliability in classroom observ.tion 
sveraged .82 over all categories. The stability over a four-day 
period of teacher behaviors was estimated at .78 (Leinhardt. 1976). 
in later studies. videotapes replaced in-class observers and 
reliability increased to .95 across categories and observations 
(Leinhardt, 1978). 

Assessing program features . The first set of field-based 
empirical studies focused heavily on the types of assignments students 
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received, how stud tut and teacher tint and classroom space wera used, 
and whether implementation procedures were followed in accordance with 1 
initial suggestion* and program apecificationa. 

The baaio finding of this early research was that an LRDC Follow 
Through olassroom did indeed look very different from a traditional 
one. The Follow Through olasarooma ware also different in many 
respects from the developmental olasarooma in Pittsburgh. The Follow 
Through olaasrooma, however, more olosely resembled the developmental 
than the traditional classrooms. 

Another finding was that modifioations which were made in the 
field often Improved rather than detracted from the program. For 
example, in the early stagea of Implementation, the Follow Through 
schools did not test as frequently as suggested (every four to five 
days). This increased time between tests (seven to eight days) was 
found to have a positive Impact on student achievement (Leinhardt, 
1976). While this finding should not be interpreted to mean that 
testing was an unimportant part of the program, it does indicate that 
the optimum frequency for testing must be established in the field 
(Leinhardt, 1977a). 

In the early field research, there was a divergence of opinion 
between LRDC 1 a Follow Through field staff and resesrchers about the 
implementation level of the program features. Initisl estimates 
gsined through our research indicated that the program features were 
very well implemented and fit very closely with the model. 
Information collected by the field'staff^, on the other hand, indicated 
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a less than optimal implementation. They felt that many altea were 
not implementing major features of the program. The difference lay In 
the definition of major features. For research . purposes, it was 
sufficient that testing occurred at reasonable intervals, that testing 
information was apparently being used for diagnosing student learning 
needs and prescribing appropriate learning tasks, and that the teacher 
funotioned properly in the traveling mode by moving about the room and 
interacting with children one at a time. However, the field staff 
were concerned that the testing procedures be used with greater 
precision. For example, they wanted to be sure that 
currioulue-embedded tests (CET's) were not used instead of posttests 
and that units which seemed to cause difficulty were not skipped. In 
other words, the researchers focused on a more general level while the 
laplementors, or the field staff, focused on a more specific level. 

Occasionally, however, the data from research studies did reveal 
some specific implementation problems. In 1973. for example, it was 
discovered that there -was no variation in the initial plaoement of 
students in the mathematics curriculua at one site. The reason given 
by the teachers was the lack of time for testing children at the 
beginning of the year. For this reason, all students in one grade had 
been placed in the. same unit. This information was fed baok to the 
sites through the field staff. Interestingly, the percentage of 
unique student assignments at this site increased from 0 to 8^ over 
the next four years. Presumably, this change was partly the result of 
data from the research studies being "fed baok" to the site. 

As a result of the research, some generalizations were able to be 
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made about the nature of implementation of the IELP at different types 
of sites (i.e., urban versus rural, and black versus white, or 
integrated) .... One question that was often raised was whether observed 
differences in the degree of implementation related systematically to 
some contextual variable associated with particular sites* For 
example, parts of the program, were field tested in predominantly black 
inner-city schools. It is therefore possible that either the 
implementation mechanisms or the style of the programs that resulted 
would favor black urban settings over white rural ones. On the other 
hand , the program developers and implementors were predominantly' 
dollege educated whites which suggested that the programs might be 
more easily implemented in white settings* 

In one study of the implementation of the IELP in the' 
LRDC-af filiated Follow Through classrooms, the effects of the 
geographic location and the racial makeup of schools were examined. 
Ten implementation variables from four domains (time usage, assignment 
procedures, student autonomy, and teacher attendance) were seleoted 
and contrasts were made using a Multiple Analysis of Variance 
(MANOVA). Table 2 shows the results of that analysis (Leinhardt, 
1977a) . 

Table 2 lists the four domains and ten measures in the left-hand 
column. To the immediate right of each measure is the probability 
(univariate p) that Jhe observed differences would have occurred by 
chance. Thus, with respect to the first measure, percentage of time 
in individualized activity, there ware differences between urban and 
rural locations that could be expected by chance half the time. (or no 
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Table 2- 

Efftcts of Geographic loettlon and Radii Composition on Implementation 
of the IELP in 62 Follow Through Sacond'Grada Cliurooms 




Allocation of time 

1) % of tima in indivtdualind activity 

2) tha number of minutes in mathamatici 
3} math mainttnanca program usad 



Univariate 



Commintt 



Command 



,46 Individuilizad tlmadoH not vary system- ' ,16 Individualized tima doei not vary mm 
atically with gaograpaSfc location of school , My with racial companion of school 



,00 Urban schools spend mora time In 
mathematics 

,92 Maintenance program usage does not vary .63 Maintenance program usage does not vary 



,03 Predominately black and integrated schools 
spend more time in mathematics 



g Assignment Procedures 

4) % of unique assignments 



6) percent of pretests 

6) percent of CET'i 

7) number of day I between testing 

8) student progress in math 

Student Autonomy 

9) sum of checklist 

Attendance 

10) number of deyi the teacher was absent 



systematically with geography 

,38 Assignment uniqueness does not vary 
lyitemetically with geography 

,011 Urban schools give more pretests 
,00 ' while rural schools give more CET's 



systemetlcally with racial composition 

,76 Assignment uniqueness doei not vary 
systematically with racial composition 

,02 1 Predominately black schools give more pre- 
,00 1 tests while predominately white schools 



give more CET'i 

,18 Frequency of testing does not very system- ,28 Frequency of testing does not vary system* 



atically with geography 



atically with racial compoiition 



.83 Amount of progress does not vary system- .31 Amount of progress does not vary lyitem 



atically with geography 

.16 Degree of autonomy offered students does 
not vary syitematlcally with geography 



atically with racial compoiition 

Degree of autonomy does not vary systemi 
atically with racial composition 



.93 Frequency of absences does not varyi 47 Frequency of absancat doei not vary 



tyitematicellywithgeoiirephy 



systematically with racial composition 



Hpji. Adapted from Leinhydt, 6. Evaluating An Adaptive Education Program: Implementation to Ropllcation, ImwtloMl Scitnct, 1977, S, 223-267. 
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significant difference). .Immediately to the right jft the p value is a 
statement of interpretation. To the right of that is the probability 

0 

of differences associated with racial characteristics in the 
composition of the school, followed in turn by an explanation. The 
table can be read across each row without attending to the numerical 
information* 0 

Essentially, the findings show few significant differences that 
could be expected to affect student performance. An exception is that 
urban and black schools spent more time in mathematics than iwhite and 
rural schools. In assignment procedures, urban and black scjwola used 
more pretests while rural and white schools used more CET's. There 
was no difference, however, in the uniqueness of assignments (degree 
of individualization), frequency of testing, or student progress. 
These results do. not indicate that there were no differences in 
implemen^fCbion procedures among schools, only that the differences 
were not systematic with respect to some of the more obvious site 
characteristics. These findings , also suggest a successful 
implementation of the major program features in the sites (Leinhardt, 
1977 a). ; 

Student Learning Progress _in Basic Skills 

Data on student learning progress reported in this section were 
obtained from the LRDC developmental classrooms where most program 
design research was carried out, and from Follow Through sites where 
some of the' components of the Individualized Early Learning Program 
were implemented. This discussion wiU include information on student 
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learning progress In the basic skills curricula and standardized 
achievement test results. Since detailed • discussions of student 
progress have appeared in several previous reports (Eichelberger & 
Boston, 1976a; Rosner, 1972; Wang, 1976a; Wang, Resnick, & Schuetz, 
1970, 1974), the following are brief summaries of this information for 
illustrative purposes. 

Student learning progress in the basic skills curricula. 
Integrated into the IELP's recommended classroom processes is the 
administration of diagnostic tests to determine students 1 mastery of 
the objectives in each of the prescriptive curriculum (Cox & Beaton, 
1967; Wang, 1969). The diagnostic test results provide a basis on 
which teachers "prescribe learning tasks for children. Test results 
also provide a record of student learning progress in the program. 
.The .purpose of analyzing the student learning progress data was to 
determine, whether the students were able to master the program 1 s 
objectives and whether previous experience'* in the IELP made any 
difference in student entering behaviors. To investigate how children 
make progress in the IELP curriculum, the data from the developnental 
classrooms and Follow Through schools were examined. 

Summaries of mastery in the Quantification, Classification, and 
Reading curricula by students from the developnental classrooms are 
reported indoles 3, 4, and 5 (Wang, Resnick, & Schuetz, 1.97*0. ;,The 
tables show the. percentage of students who mastered each of the units 
in the various curricula by the end of the 1969-70 school year. The 
data in the tables were obtained from an inner-city - public school at 
the end of the second year of program operation. As shown in Table 3, 
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Tiblt 3 

Percentage of Students Mastering Each Unit in the Quantification and 
the IPI Mathamatia Curriculum at End of School Yeer 
1969-1970 



Unit 



3Yaan 
N-23 



Aga Group 



4 Ysers 
N-33 



Kindergvtm pjn. 
N-S6 



Kindergarten 
N-62 



First Grade 
r N-133 



Quantification 



T. 


Counting 1-6 


69 


81 


93 


100 


93 


2. 


Counting 1 - 10 


32 


78 


88 


100 


91 


3. 


Numeration 0 • 5 


36 


75 


88 


90 


93 


.4. 


Numeration 6- 10 


18 


56 


81 


92 


81 


5. 


Comparison of tats 


9 


47 


90 


' 85 


85 
77 


6. 


Seration 


14 


34 


70 


77 


7. 


Addition and 
Subtraction 


5 
5 


8 
6 


49 

*> 


66 


83 


8. 


Addition and 






12 


21 


28 
93 




Subtract s equations 






19. 


Counting 11; 20 . 


5 


28 


58 


. 58. 


10. 


Numeration 11-20 




6 


47 


60 


86 


11; 


Counting 20 -100 




i ■ 


21 


27 


66 




Numeration 20 -100 






4 


10 


38 


13. 


Counting 100-1000 








4 


19 


14. 


Numeration 










*5 



IPI Mathematics 
Laval B 
Level C 
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Table 4 

Percentage of Students Mastering Each Unit of the Clarification 
Curriculum at End of School Year, 
1969-1970 



3 Years* 

Unit N»23 

Classifi cation I 

1. Matching A *7 

v 2. Simple dessification 41 

3. Classification of objects . 

varying in 2 dimensions " . SO 

4/ Color naming 

5. Shape naming, 4 * 

6. Size description 9 

7. Advanced classification 

Classification II 

1. Singular and plural objects 

2. Reverse order ident. 

3. Prepositional statements 

Qassificationlll ## 

1. Multi-dimensional classification 

2. Classification of fundtonai categories 

3. Category naming 



Group 

4 Years Klndtrgwitn ojn. Klndergwttn «jti. 



N-33 N-56 N-52 



75 95 90 

66 95 94 

72 96 90 

59 91 98 

56 88 92 

25 . 68 73 

19 66 71 

19 74, 75 
3 63 

57 . 56 

58 71 
47 71 
53 65 



• Unit not induded in the curriculum for mis age group. 
Classification III was not used in preschool and kindergarten. 
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Table 5 






Percentaga of Students Mastering Each Bc^ c* the 






McGraw-Hill. Sullivan Reading Series 






1989-1970 

■»>' . .. 








Grade 1 


Unit 


Topic . 


N - 133 


1. 


Firtt transitional reader 


84.4 . 


2. 


Second transitional reader 


RQ A 
Dv.4 


3, 


Initial and final consonant clusters; contractions ^ 


48.9 


4^ 


"ad" suffix of past tense varbs 


40.6 


5. 


Inflectional and derivational suffixes "as" and M er" 


31.6 


8. 


Inflectional and derivational suffixes "et" and "est"; 






complex sentence structure; paragraphs 


22.6 


7. 


New initial and final consonant dusters; suffix "ay" 


13.5 


8. 


Short "o"; "2" and "qu"; poems, descriptive paragraphs. . 


10.5 




short stories; colon 


9. 


Final '>"; long "a" with final silent "e"; soft "c" 


6.0 


10. 


Long "1" and. "o"; soft "g"; longer stories 


6.0 


11. 


Long vowels not followed by firial silent "e"; long "u" 


6.0 


12. 


Words ending in "oy" and "Igh"; animal sounds; concepts 


4.5 




"bright" and "pale" 


13. 


"ee"; longer selections on natural sciences, with emphasis 


3.6 




on comprehension and retention; semi-colon 


14. 


"ew", "oo"; descriptions of natural phenomena and human 


3.0 




institutions, with emphasis cn comprehension and retention 


15. 


"ow". "ea'\ "wb", "ph'\ silent "t" and "w", "kn'\ "ch"; 


1.5 




suffixes "tun" and "ation"; months and seasons 


16. 


"ould" "dge". silent 1" and "h", "wr"; usaga of "could" 






"should" and "would"; history, wi$h emphasis on comprehension 


1.5 




and retention 
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the typical four-year-old r example, could perform counting, 
nuneration, comparison of seta, and serlatlon, while five-year-olds or 
kindergarten students advanced to units on addition and' subtraction 
operations up to 10 by the end of the school year. 

To further exanlne student progress In the curriculum, 
comparisons were made' between the total number of Instructional 
objectives (In Quantification) mastered at the beginning of the school 
year (entry level) and the total number mastered by the end of the 
school year (terminal mastery) for each age group. Figure 8 shows . 
these results graphically. A consistent pattern of positive student 
progress in the curriculum Is clearly reflected in the data. At every 
age level- (three years through first grade) students' mastery of the 
objectives of the Quantification Curriculum Increased significantly 
between the beginning and the end of the school year . 

Data displayed In Figures 9 and 10 represent student learning 
progress Information from the seven LRDC-af filiated Follow Through' 
sites for the 1973-74 school year. Figure 9 shows the number of IPI 
Mathematics units mastered at the beginning (placement) and at the end 
of the year (final location) by second-grade students In the sites. 
On the average, children at the end of the second grade had completed 
20 units of the curriculum. Figure 10 shows the number of Sullivan 
reading books completed by Follow Through students upon entering and 
leaving second grade. In general, students had covered approximately 
half of the Sullivan Series by the end of second grade. 

Standardized achievement test results.- The Wide Range 
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P - plactmtnt □ 
FWfiiMi location 
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Figure 9. Student learning in 
Second Gridfl Follow Through 

'(1973.74) 



P ; F 
Site 7 
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Flgun 10. Studmt teaming In Sultivan^atdirg. 
Sacond Gradt Follow Throuoti 
1197*74) 
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Achievement Test (Jastak, Bijou,, 4 Jastak, 1965) was one of the 
standardized tests used to v assess the end-of-year achievement for 
students in developmental and Follow Through classrooms. The 
evaluation design (Wang, 1973a) for both the developnental schools and 
the LRDC Follow Through classrooms involved beginning initial testing 
at the lowest grade. The grade one year ahead of the grade in which 
the IELP was Implemented was used as the comparison group for 
evaluation purposes. The intent was to compare the. test results of 
program students with children from the same neighborhoods, .families, 
and school. Thus, for comparison purposes, the WRAT was administered 
to children who were in the same school but had not been students in 
classrooms where the IELP was implemented. The central question in 
examining student achievement was whether the IELP made a difference. 

Table 6 shows longitudinal comparisons of the Wide Range 
Achievement Test \ WRAT) results of those Follow Through students in ah 
inner-city school system who had the Individualized Early Learning 
Program and those students who did not. Data displayed in Table 6 
include WRAT results from the first . year in which the IELP was 
implemented in the schools through the 1976-77 school year. The 
Individualized Early Learning Program was initially implemented at 
this site during the 1970-71 school year. The.overall results show 
that the mean grade equivalent scores for all Follow Through groups 
were close to, or above, the national norm, reflecting the positive 
impact of the program on student achievement. When comparing the 
achievement scores of the Follow Through and non-Follow Through groups 
. in the same school system, the impact of the program is even more 
evident. As one reads across the rows in Table 6 to compare scores 
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Table 6 

Summary of WRAV Diti fro nOw Follow Through School 
Mean Gretie Equivalent Scorn 
* 1971 -1977 



1071 



1872 



1973 



1074 



Kdf. 1.0* U 
'bit I139l b 031) 



nodite 



Rut M 1.7 1* » 



•Second 2.4 

*lnl. (71) 

ThW 3j0 

(n) 181) 



22 
173) 

3D 
(68) 



2* 2.4 



32 3.1 
182) (82) 



two. 


"Arllb: 


Read. 


ArlS. 


IJD 


IjO 


K9 


1.1 


152) 


(62) 


144) 


(441 


IS 


2jQ 


22 


20 


IS7) 


(57) 


(441 


144) 


24 


24 


2& 


2.9 


(1461 


. (1481 


, (43) 


(42) 


3.5 


3.1 


42 


3/4 


1150) 


(150) 


(44) 


(441 



1076 



1076 



1077 



13 


12 


1.1 


1,1 


U 


13 


(40) 


(40) 


(40) 


(40) 


(40) 


(40) 


2.1 


23 . 


24' 


< 

22 


22 


23 


(42) 


(42) 


(43) 


(43) 


130) 


(30) 


1.1 


24 


3i 


3D 


3B 


2JB 


144) 


(44) 


{(41) 


(32) 


(32) 


(32) 


3J 


34 


42 


33 


45, 


3.4 


142) 


(42) 


(43) 


(431 


(38) 


(38) 



' WRAT it giwfl by LROC tiww*i local admlnlitraton In iprlngof each yew. 

a-ljOGrt*M*enlScori 
b-039) Number Siudwti Tutad 

&te: Group above the ittpped Mne wert In the Follow Throo(h pfoflram. Groupa beliw It «ee«i not in the pfogrem. 
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from the. same grades across sohool years, a consistent pattern of 
differences in the achievement scores of the two groups can be. 
observed. In all cases, scores from the Follow Through groups far 
exceeded those of non-Follow Through groups of the same age for the 
preceding year. 

It is also interesting r to point out that when scores for the same 
group are followed across the years a pattern of progress in 
achievement scores can be detected . With each year of additional 
experiences in the program an increased gain is observed. Tracing the 
progress made by the kindergarten group of 1973-7*1 through their 
third-grade year (1976-77). for example, students in the 
Individualized Early Learning Program performed approximately at grade 
level in the spring of their kindergarten year. By spring, of their 
first-grade year they scored slightly above the grade norm in both 
reading (2.1 instead of the expected 1.8) and math (2.3). In the 
Spring of 1975-76, which was their second-grade year, they again 
scored well above grade level in reading (3.5) and above grade level 
in math (3.0). This pattern of progressive increase continued in 
their third-grade year. Their grade equivalent scores from the spring 
testing of the 1976-77 school year were 4.5 for reading and 3.4 for 
math. 

Student achievement data from each of the LRDC Follow Through 

■i 

sites, as measured by the WHAT at the end of each year, are in Table 
7. These results were obtained from the average gain in WRAT grade 
equivalence (G.E.) scores for one group of students in each of the 
sites from the end of kindergarten to the end of the third grade. As 
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K-1 .1.1 1.1 



Ttbli 7 



' Avtragi Gradt Equiwlant Gaiw in WHAT 
Rtatfngwd Math Subtttts for tht LRDC FT Studanti 




U *U 0.9 1.1 13 0.8 1.0 0.7, U0.8 0.9 1.0 



t-2 0.9 0.7 



1.3 0,^ 



2-3 1.1 03 1.2 0.6 



1.4 0.G 



1.6 1.0 1.4 0.fl 



3.5 2.7 4.9 2.6 



Joul 

Gai n 3.1 2.6 3.B 2.6 

•R - Raadlng 
"M«Math 

m From "Tba LRDC FollowThrou* Indavlduiliwd Early Laarning Program" 
by EicttalbargarSi Boston, 1976. 



1.3 0,8 



li2 03 1.2 0.8 1.4 1.2 M 0- 7 U 07 




3,9 2.9 4.1 2.4 3.5 2.6 



:erlc 
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pointed out by Eichelberger and Boston (1976b), since the expected 
gain for each year would be 1.0 G.E. , with a total 3.0 G.E. for the 
three consecutive school years, the results reported in Table 7 
represent abov^average growth. In fact, reading results which ranged 
from 3.1 G.E. to 4.7 G.EJ not only represent above average growth 
for the national population, but also represent exceptionally high 
results for the Follow Through population. The U.S. Department of 
Education uses 70% of average growth as the expectation for 
disadvantaged students (General Accounting Office, 1975) which, in 
this Instance, would be only 2.1 G.E. 

V 

A consistent pattern of achievement gains has been noted even 
though the data from the developmental and Follow Through schools 
varied from year to year and from classroom to classroom. Children in 
classrooms where the Individualized Early Learning Program is 
implemented generally learned what they were taught. On the average, 
Follow Through students in the program performed better than those 
with similar characteristics and backgrounds, and they scored at or 
above the national norm on standardized achievement tests in subjects 
that were explicitly taught in the program. Furthermore, the data 
suggest that the degree of program Implementation was related to the 
degree of impact on students. As the quality of the program and its 
implementation improved over the years, an increase in student 
achievement gains was noted. 

• t Discussion 

Many insights related to the development, design, and evaluation 
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of an innovative instructional program such as the IELP were gained 
during LRDC's ten years of participation in the National Follow 
Through Program. This section will focus on discussing the 
information and experiences gained in four areas: the design of the 
instructional program, the individualization of the implementation 
process, program evaluation, and a oontrast of instructional design 
and program implementation research findings. 

Program Design 

Although the basic goal 4 of developing sohool learning experiences 
that are adaptive to the needs of the individual child has not changed 
since the inception of the IELP, ideas about what is required to 
accomplish that goal have gbne through many iterations. One of the 
most significant changes was th£ broadening of the definition of 
curriculum. Another was the change in the "how to" aspect of bringing 
theories and research to bear on design and the requirements for 

utilizing rese'arch and development ideas and products to change school 

■ 

practices . * / 

* \ 

* . Curriculum development includes not only tasks of translating 
program goals into specific ourriculun (learning) objectives, and 
designing the content and its sequence, but also includes tasks 
related to the implementation of the curriculum in classroom settings. 
As stated earlier, the curriculum defines the educational experiences 
and learning opportunities that are open to the individual student for 
the achievement of the program 1 s objectives. Therefore, "curriculum" 
is viewed in the IELP as including learning objectives, sequence 
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structure, -learning tasks, instructional tasks, methods and procedures 
for diagnosing the"entertngn>eha^iors of the learner, monitoring and 
evaluating student learning, physical design of the classroom, and an 
instructional- learning management system. 

Much work went into designing implementation strategies for the 
IELP during the initial phases of field testing. The notion that all 
that was needed was to provide the teacher with empirically validated 
curriculum packages and exploit directions about how to use the 
materials in order to effectively implement the innovations was aoonr 
re^nized as naive. Merely supplying teachers vith new ideas, 
products, and training was not sufficient. Teachers also needed 
design supports for the total operation of their daily instructional 
activities. 

Contrary to the belief that it is possible to create 
teacher-proof curricula, effective implementation of innovative 
programs, even the most well-developed and systematically field- tested 
ones, cannot occur without a competent teacher. LRDG's Follow Through 
experiences have shown that it is the ability of the teacher to use 
the innovative educational programs that determines , to a large 
extent, the effectiveness of the programs in meeting the needs of the 
individual student. 

The student also needs to be considered in the design process, 
not only for the purpose of maximizing the effectiveness of matching 
learning experiences and student learning characteristics and needs, 
but also for the purpose of maximizing effective day-to-day classroom 
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Operations, Special attention must be given to the development of the 
management competencies required if the student is to function under 
such an instructional program. These management skills should be 
considered to be as important as other learning skills. The design of 
any innovative instructional program must Include explicit statements 
about the role of the student, the teacher, and the curriculum, as 
well as the nature of the interactions among them as they are 
reflected in the classroom process, , 

Individualization of the Implementation Process 

The implementation of an innovative program is not a process in 
which the total program, as designed by curriculum experts and R&D 
agencies, is Installed Intact initially and expected to remain so. It 
is a gradual process generally adapted to different sohools and 
different teachers' classrooms. This was found to be true even in the 
demonstration classrooms In LRDC's developmental schools. That this 
happens is not surprising* Schools differ in staff, student, and 
community characteristics* It is unrealistic, therefore, to expect to 
use a uniform process to achieve full Implementation of the. critical 
features of an innovative program in all situations* 

Innovations are seldom adopted and implemented as the program 
developers Intended them to . be at the outset. Installing and 
maintaining an innovative educational program should be viewed as a 
developmental process. This process Includes the development of the 
teacher's readiness to accept and learn to Implement the program (or 
components of It) , as well as the development of the capacity of the 
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local school to adopt, and to adapt, the kinda of innovation that the 
program ia deaigned to repreaent . Baaed upon ita experience in 
implementing the IEU> in a variety of claaaroom settings reaearchera 
at LRDC have come to believe that a key to effective implementation of 
innovations in schools is the use of an individualized approach. That 
ia it is important to incorporate a gradual developmental proceaa 
that permits complete implementation to eventually occur through the 
individualization of the implementation process. 

Program Evaluation 

in retroapect, the most aignif leant aingle lesson for program 
.valuators that emerges from LHDC's Follow Through experiences seems 
to be the need to make the evaluation proceaa iterative and 
interactive. Educational evaluationa ahould be carried out over at 
leaat a one-year period, with the reaults of any one study being used 
as the baaia for revising future atudiea. The evaluator needa to 
interact with three basic groups in designing and carrying out auch 
work: curriculum designers, school and implementation personnel, and 
the research com»unity-in that order. These group, represent 
auccessive decision makers to whom evaluation information is relevant. 

Early iterationa of research ahould grow out of deaign 
apecificationa for programs. Thia asaim.es that early work will focus 
on information most useful for designers. Such an approach also helps 
to aaaure that relevant information will be available to the 
deaigner/developer when he or ahe is still interested and able to make 
modifioationa or build additional ccmponenta. 
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The next iterationa of research ahould include information that 
ia eapecially relevant to the school and implementation community. 
Including such school- re lev ant data helps to aaaure that within the 
firat two yeara (aaauming each iteration la a year) of data 
collection, information of relevance and intereat to schools is being 
collected and can, therefore, be made available to them. 

Later iterationa ahould include both school implementation and 
research interests. The increased emphasis on the research community 
is important in aaauring that methodological procedures are maintained 
at a high level and cauaal inter pretationa are carefully made* In 
this way, the perapective of the research can be broadened and the 
research can be linked with parallel efforta in the field aa a whole* 
Thia doea not advocate doing research for groupa in atrictly linear 
succession; rather, it auggeata that auch research start with one 
emphasis that gradually alters and broadena to include other 
perapectives. As the emphaaia changea and broadena, the context in 
which the research takea place ahould also broaden to include more 
classrooms and a variety of settings and grades* 

A final point concerning the use of control groups in program 
evaluation should be made. The claaaical paradigm calla for the use 
of contraating groupa on which to base cauaal arguments. It should be 
clear from the work described earlier that LRDC doea not, in general, 
use such an approach. Experience in evaluationa conducted by the 
National Follow Through Program indicates that in large field studies, 
control groups rarely, if ever, bear any resemblence to the treatment 
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group and thus . are of little value. One alternative Is to use 
self-controls. Examples of such controls would Include the historical 
or repeated measure designs, such as the multiple baseline designs, 
and the reversal design in ABA or ABAB formats . These approaches, 
however, are not always feasible on a large scale. Another 
alternative involves: (a) employing convincing models of how 
treatments bring about results. (b) including estimates of 
instructional processes in the data, (c) replicating the results over 
time, and (d) expanding the group in which research is conduoted to 
guarantee variation in the treatment domain (Cooley & Leinhardt. 1975; 
Leinhardt. 1978). The point in educational research should be to 
develop convincing arguments as to the plausibility of results, and 
determine if the data are consistent with those arguments, rather than 
to declare immutable laws* 

Contrasts of Design and Implementation Research 

Two independent lines of research on the IELP have been carried 
out. The research focused on questions concerning the design, 
component fit, implementation, and impact of the program. The general 
procedure used for developing and implementing the program was: (a) 
to design and try out program components; (b) to modify the design 
and put the first generation of the program in developmental 
classrooms; and (c) to modify and implement the program in a wide 
range of classrooms, mostly Follow Through classrooms. This approach, 
however, generally created a gap of two to five years between the 
first and third steps. The purpose of this section is to contrast and 
interpret the findings from these different phases of the research. 
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The focus will be on three topics that have been consistently studied: 
assessment of student learning, the effects of teachers 1 verbal 
Interactions with students, and the effects of Increased student 
autonomy on student growth* 

Assessment of student learning * A major feature of the IELP is 
theQ existence of built-in devices (i.e., criterion-referenced 
diagnostic tests) to assess student learning progress. In general, 
there are four categories of criterion-referenced tests that are used: 
placement tests for each level of the curriculum, administered when 
the student enters the program; pretests for each unit of the 
curriculum; curriculum-embedded tests for each objective; and 
posttests for each unit of the curriculum. These tests are used to 
assess the competency and mastery level of students and to Inform the 
teacher about student progress. While some research has been done on 
the particular patterns of use for each type of test (Lelnhardt, 
1976), the question of common Interest is, "How valuable Is testing?" 

Wang (1973d) addressed this question from the program design 
perspective in a study In which teachers were asked to estimate 
students' performance levels under conditions of maximum and minimum 
test information. The study found that even experienced teachers 
needed relatively frequent feedback from tests in order to predict a 
child's performance accurately. Lelnhardt (1972, 1977b), on the other 
hand, addressed this question from a program evaluation perspective to 
determine, the optimum frequency of testing. If a student is doing 
nothing but taking tests, it is obvious that the student will not be 
spending time learning new material. If, on the other hand, a student 
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is tested very infrequently, it is likely that the assignments will 
begin to diverge from the student's real needs. Results of 
Leinhardfs study indicated that students should be tested regularly 
but not too frequently. The optimun frequency for testing in the 
IELP's math program appears to be every five to ten days. 

Teacher contact. A second line of questions dealt with teachers' 
verbal interactions with students. While many questions were 
investigated in this area, the overlap between experimental classroom 
studies carried out in the developmental classrooms and field research 
studies conducted in the LRDC Follow Through sites was on the type, 
duration, and frequency of contacts. Wang- s experimental studies 
(Wang, 1976.; Wang 4 Brictson, 1973). which used task completion 
rates as the dependent variable, showed that student task completion 
rates Increased significantly when teachers increased the frequency 
and length of their task-oriented contacts with students while 
decreasing their management contacts. 

Research in field settings has shown that to ' improve student 
performance on standardized achievement tests, teachers must: focus 
their attention on cognitive material (e.g.. reading and math); make 
frequent cognitive contacts (and few management contacts) with 
individuals, as opposed to groups; and have contacts of less than two 
minutas' duration (Leinhardt. 1976. I977<*b. 1978). How can these 
different findings concerning length of contact be explained? While 
there are no data that specifically address this question, a closer 
review of the findings and the context of the studies can be made. 
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Wang's research was conducted in five to ten classrooms in LRDC's 
developmental, schools, where the student was the unit of analysis and 
where both the students and teachers had received training in not only 
the curriculum components, but also in self- scheduling. Leinhardt's 
research was conducted in 30 to 60 LRDC-af filiated Follow Through 
classrooms, where there had not been such in-depth training. It may 
be that the important aspect of cognitive instruction is student 
contact with cognitive material at the appropriate level for the 
maxim un amount of time. In the Follow Through classrooms this was 
accomplished by having the teacner contact a large number of students 
and focus those contacts on cognitive questions. In the developmental 
classrooms this was accomplished in part by the teacher and in part by 
student self-scheduling. interestingly, data from both settings 
support the idea that an increase in management contacts leads to a 
decrease in student academic growth. 

Student autonomy . A third topic that generated much interest in 
both the instructional design research and the field implementation 
research on the IELP was the effects of increased student autonomy on 
student academic growth. Leinhardt and Wang investigated the 
relationship between increasing levels of student independence and 
levels of academic growth. Data from the developmental schools 
consistently indicated that it was quite possible to maintain high 
levels of both student independence and academic growth (Wang, 1976a; 
Wang 4 Br ictson , 1973 ; Wang , Mazza , Haines , 4 Johnson , 1972) . 
Leinhardt 1 s data from field research had more ambiguous results 
(Leinhardt, 1972, 1977a & b) . She found that some types of autonomy 
(deciding when to take a test, moving from cognitive to noncognitive 
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areas of work at will) are dysfunctional , while other types of 
autonomy (deciding to work on a particular math unit, peer tutoring, 
and beginning work upon arrival at sohool) are more functional. These 
differences may be due to Hang's focus on student reports of autonomy 
and observed rates of Initiation (tang 4 Stiles, 1976). while 
Lelnhardt focused on teacher reports (1977a) . 

, As Indicated In the discussion of the research, while the seeming 
contradiction between the results of the experimental and the field 
studies cannot always be directly explained by the data the 
differences may be attributable to the setting or the unit of analysis 
used. Progrmn implementation In the developmental classrooms, where 
the experimental research was carried out , was monitored closely by 
the investigator, while implementation In the Follow Through sites did 
not Involve the investigator. Further research to .help explain these 
differences will contribute both to, knowledge of Instructional design 
and to an understanding of the factors affecting the implementation of 
the IE LP. The implementation process must be adjusted to adapt to the 
needs and the entering competencies of the implementors (the teacher 
and principals) as well as to the contextual constraints of the local 
flohools. 

Some Final Remarks 

The central question surrounding the development of the 
Individualized Early Learning Program was "how to help children learn 
■ore effectively-. LBDC's participation In the National Follow 
Through Progrm has provided an Invaluable opportunity to find some of 
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the answers to this question. A great deal is known about how 
learning takes .place and which instructional intervention strategies 
tend to be more facilitating than others in fostering student learning 
in certain contexts. Program development and implementation 

a 

experiences suggest that this knowledge can be incorporated into the 
design of innovative school practices that could be very effective in 
facilitating student learning. 

The development of effective programs requires a systematically 
planned iterative process of design and evaluation research. 
Instructional experimentation as well as field research are needed to 
provide pertinent information regarding the effects of the components 
of a given learning environment on student learning. Furthermore, 
Implementation of innovative school practices requires an adaptive 
process. The implementation of even the most carefully designed and 
empirically validated school programs must still undergo adaptations 
at the local level. Creative assimilation of the innovation by the 
user is the key to successful dissemination of innovations and 
effective implementation in classroom settings. 
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Appendix A 



Selected Samples of Objectives Included 



in the Various Prescriptive Curricula 
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Terminal Objectives of the IPI Mathematics 

i 



urn 










Topics 






Numeration* 
Piece Value 


Addition- 
Subtraction 


Multiplication 


Diviiion 


Fraction! Money 


Time 


Syiti 


A 


Ordering by 
lin; more 
or leu 


Union of ette; 
removal of 
subseti; addi- 
tion sentences 






Equivalent Matching 
ptrtj coin name! 

picture 


Deyi of 
me weai 




8 


Numeration 
10-100 


1 digit 
numben 


Number line 
and groupa of 
object! 


Number line 
end groups 
of object! 


Partitioned Identifying 
object! colm 


Houn 


liii 


C 


Nunwitlon 
100-1000 


2 digit num- 
ber! 

<m 


Product! to 46 Relating mult- 
on digit lector! Ipllcetionto 
division 


Identifying Velueof 
numerator! A colm 
denominators 


Minute before 
end pet the 

hour 


Incr 
foot 
ine 


0 


Nurrarttlon 
to 9*999 


4 digit 
numben 


2 digit factors 
three -tdtgit 
factor! 


Word problems 


Equivalent Making change 
fecton 

1/2-2/4 


Writing time 
in itenderd 
form 3:16 


Meel 

tarn 

■ 


E 


NuflwitlOfl 

flflfl QQQ QQQ 
998 ,009,91 9 


Five 6 digit 

'Attn 


Four 1 digit 
fecton; three 
digit dividend 


Two digit 
divisor; three 
digit dividend 


Common, mix- 
ed, decimal end 
expanded nota- 
tion 


Mlnuteaend 
aecondipHt 
the hour 


Ind 
yen 

oun 


F 


Mixed decimal 
numerate 


Oecimei! 


.Mixed decimal 
fecton 


6 digit 
dividend! 


UIkmI nuiMrali 
and common 
fraction! 


Determining, 
elepsed time 
between two 
given tlmei 


Des 
ere 

voli 


G 


Scientific 
notation! 


Neoative 
integen 


Decimal!, 
lignad Integer! 


Decimal!, six. 
digit dividend 


Renaming w 

common, decimal, 
or percent 




Ida 

tun 
voli 




>f Geometry ty>pilcatk 

Wit 



A 

wnts 

rwi 

dozens 


Closed end 
optn curves 


Numbar as 
tancesons 

digit 


i ■ 
P* 

1 


Identifying 
plant f Igures 


Using whs 
bean learn 


►0 

tore 


Points, Hot ho* 
menu, rays, 
lines 


Using whi 
baan laarr 


eat 

lias, 
torn 


Idanti fylng 
engles 


Using whi 
baan laarr 


nlofl 
d 


Measuring 
anglas 


Oanomiru 
numbars 


log 
tree 


Polygons 


Using whi 
baan lean 
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Objectives of the Quantification Curriculum 



GIVEN: 



Units 1 end 2 

Counting end Ona-t o-O na 
" COTeaoondence* : - 



A. Vtrtoal instruction 

8 . Set of movable objects 

C. Fixed ordered set of objects 

D. Plxed unordered tat of .objects 

E. A numaral natad and a tat of 
objacts 

P . A numaral itatad and atvaral sati 
of fixed objacu 

G. Two sets of objacts 

H. Two unequal tats of objects 
I . Two unequal tats of objects* 



THE CHILD CAN: 

A. Recite the numerals in order 

B. Count the objects, moving them out of the set 
et he or the counts 

C . Count the objects 

D. Count the objects 

E. Count out e subset of stated size . 

P. Select a sat of size indicated by numeral 

G. Pair objects end state whether the sets ere 
equivalent 

H. Pair objects end state which set has more 
I . Pair objacts end state which set has lass 



Units 3 end 4 


A. 


Two sets of numerals 


A. Match the numerels 




B. 


A numaral stated, end e set of 


B. Select the stated numaral 


Numerals 6 




printed numerals 




C. 


A numeral (written) 


C. Read the numeral 




D. 


Several sets of objects end severel 


D. Match numerals with appropriate sets 






numerals 


E. State which shows more (leu) 




E. 


Two numerals (written) 




P. 


A sat of numerals 


P. Place them In order 




G. 


Numerals stated 


G. Writa the numeral 



UnitS 

Compaction °* Sets 



A. Two sets of objects 

B. Two sets of objacts 

C. A set of objects end e numeral 

D. A numerei end several sets of 
objects 



E. Two rows of objects (not paired) 
P. Three sets of objects 



A. Count sets end state which has more objects or 
thet sets have same number 

B . Count sets end state which has less objects 

C. State which shows more (leu) 

D. Select sets which ere more lieu) then the num- 
erei; given e set of objects end several numerals* 
the child can select numerels which show more 
(tses) then the set of objects 

E. " State which row hes" more regerdleu of errengement 
P . Count sets end state which has most (least) 



Unit 0 

Serietion end Ordlel ^ 
Position 



A. Three objects of different slxn 
8 . Objects of graduated sixes 
C. Several sets of objects 
O. Ordered set of objects 



A. Select the largetj (smallest) 

B. Serlete according to size 

C. Striata the sets according to size 

O. Neme the ordinal position of the objacts 



Unit 7 

Addition and Subtraction 
(sums to 10) 



A. Two numbers stated, set of objacts, 
end directions to add 

B . Two numbers stated, set of objacts, 
and directions to subtract 

C. Two numbers stated, number line 
and directions to add 

D. Two numbers stated, number line, 
end directions to subtract 

E. Addition end subtraction word 
problems 

P. Written eddltlon end subtraction 
problems in form: x or x 

G. Addition end subtrees on problems 
. in form; x + y - or x - y - 



A. Add the numbers by counting out two subsets 
then combining end stating combined number 
as sum ( 

B. Count our smaller subset from larger end state 
ramelnder 

C . Use the number line to determine turn 



D. Use number line to subtract 

E. Solve the problems 

P. Complete the problems . 



G. Complete the equations 



Unit 8 

Addition end Subtraction 
Equations 



A. Equations in form of z ■ □+ A 



A. Show severel ways of completing the aquation 



B. Equation* In form of x + y-fj+A B. Complete equation in several wevs 

C. Equations In form ofx + y- z + Q, C. Complete the equations 



x + y ■0+ z 

D. Equations in iormtx + 0*y, 
0 + x-y 

E. Complete addition equetlon 
(e.g., s + y«i) 



O. Complete the equations 

E. Writa aquations using seme numerei end minus 
sign {e.g., z - x ■ y) end demonstrate relationship 



P. Counting blocks end/or number line P . Make up completed equations of various forms 



•Unit 1 Involves sets of up to 8 objects: unit 2 Involvac sets of up to 10 objects, 



b Unfn involves numerels and sets of up to 5 objtteti; unit 4 involves numerels end sets of up to 10 objects. 
Notr Ac^ptadfrom "Adaptive Education feVVoung Children: The Primary Education Project**^ L.R. 
Resnick,M.C.Wanfl,andJ.Rosner. In Prtchool In Action: Exploring Siriy Childhood Programs 
(2nd ad.) edited by M.C. day and R.K. Parker (Boston: Allyn & Bacon, 1976). 
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Objectives of the Classification and Communication Skills Curriculum 





GIVEN: 


THE CHILD CAN: 


Unit t 

Basic Matching Skills 


, A. A lit of two obi ten 

B. Two Mentk* sets of objects 
C An array of objects varying in 

ona dimantJon 
D. Thmeotfeets- two identical, one 


A. State whether tha pairs ara tha "same" 
or "different" 

B. Pair identical objects 

C. Sort on the basis of differing attributes of 
mat dimension 

d: identify tha ona that is different 




diffarant 

E. A lampii object and three dislmiler 
object! 


E . identify tha ona that matchas tha sample 


Unit 2 

Shape and Size 
Discrimination 


A. Basic thapaa and matching outlines 

B. Irragolar thapai and matching 
outlines 

C. Two tizai of rodi and instructions 
to superimpose 

D. Two tixas of a shapa and 
Instructions to superimpose v 


A. Place the shepes on the appropriate outlines 

B . Piece tha shapes on tha appropriate outlines 

C. State whether seme or different size ' ■ X 
and give raason 

D. Stata whether same or different . end give raason 


Unit 3 

Color Naming 

* 

9 


A. An array of tha basic colors 

B . An array of tha basic colors 

C. Two identical sats of objects of 
different shadas of • coior 

v D. Ssvaral shadas of a single color 7 


ANdjnjify tha stated colors 

B. Name tha colors 

C. Match identical object! 

0. Seriate in order from darkest to lightest 


Unit 4 

Ship* Naming 


A. An array of tha savan basic shapas 

B. An array of tha savan basic shapas 


A. Identify named shapa 

B. Name tha shapas 


Unit 5 

Advanced Matching Skills 

0 


A. Two objects, sama on ona diman> A. Stata whathar tha objects ara tha sama or 
sion but diffarant on anothar diffarant end»give raason 

B. Thraa objects, varying in thraa S .« Idantify tha objact that is diffarant and glva 
di mansions, two alika on a givan raason 

Dimension and ona diffarant on ' 

that givan dimension 0 " 

C. A sample objact and • t«t of objects c. Identify object thit matches sample in one dimen- 
varying in two amenaions sion and give reasons , — 

D. An array of objects varying In two D. Race objects In groups according to one dimension 
dimensions (cotor.snape. end size) and explain tha basis for the sort 

and instructions to sort on tha basis *4 / „ 
of ona dimension 


: Units 0-9 

Big and Urt? 
Long and Short 
Tail and Short 
Wide and Narrow 


A. Two objects different in size. 

B . Two objects different in size 

C. Two objects different in size 

D. Two object! different in size 
E*. Two objects different in size 

F . Two objects different In. size 
Q. Several sizes of en object 


A. Point to the "big" ('long", "tali", "wide") objact 
B« Verbally state which objact is "big" etc. when 
asked 

C. Identify tha "little" ("ehort". "narrow") object 
0. Stata which object is 'little" etc. when esked 

E. Describe according to size using tha term "big" 
or "little", etc. 

F. Compere end statu which Is "bigger", *'smaller"etc. 

G . Seriate In order from biggest to smallest 



Not*: 



/ 



Adopted from Adaptive education Tor Toungwinurm. ■■«■ rumwy M uv*uv<> .< ~t 
Rtsnick, M.C. Wang, and J. Rosnar. In Pmchooi in Action: Exploring Early Childhood Program* is 
(2nd- ad') edited by M.C. Day and RX. Parker (Boston: Allyn & Bacon. 1976). 
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Objtctivt* of *• Visual - Motor Compoiwnt of th« PEP Curriculum 



GIVEN: * 

Unitl: A group of wnch cubat arrangad in a 
un&9 row , . - m 

Unit 2: A group of ona-tnch cubaa arrangad in a 
sirvgjt row . 



THE CHILD CAN; 
TKhTTT^uparimpo* rriatching cuoS~ 

- Unit 2: Conatruct a rapllcatlon alongaida tha modal 



Laval B 



LawJC 



Unit 1 : A group of cna-lnch cubaa arrangad into an 

intartbcklng row and column 
Unit 2: A group of ona^rKhcubai arrangad Into an 

IntarlocWng row and column 

Unit 3: A dra^ng of a group of on^^ch cubw arrangad 

into intaflocking rowi and columm 



Unit 1 : Suparimpow matching cubaa 

Conttruct application alongiida modal 



Unit 2: 
Unit 3: 



Conttruct a matching arrangamant aiong- 
aida drawing . 



unit 1 • A Dation Board F on which two rubbar bandi Unitl: 
(on^orii»!S. on. tactical) hava baw mttchtd 

Unit 2: A Oaaign Board F on ^ 
(two horliontal, ona vardcal) hava baan 

Unit 3: A*5rawing of a Oaaign Board F on ^htwo 
rubbar bandi (ona horliontal. ona vardcai) 
ara r apraaa n tad 

Unitl: A drawing of a Oaaign BoardF <^ w 
rubbar bandi (ona varticai, ona ho Izontai J 

unit 2- Ao3aT?Boart F on which two rubbar bandi 
^ (oSTlirtc^ 

Unit 3: A drawing of a Oaaign Board F on whictr w»o 
rubbar bandi (ona horizontal, ona wjrtlcall ara 

Unit 4: Ad^nTof a Oaiign Board F on whWMhraa 
rubbar banda (ona horiiontal, two varticai) 
ara rapraaantad ' 



SuparimpoM two additional rubbar bandi 
RapHcata pattam on lacond Oaaign Board F 

Unit 3: Conttruct th* pittarn on a Daaign Board F 



Unit 1 : Traca accurattly ovar tha two Unai 



Unit 2: 
Unit 3: 



Unit 4: 



Rapticata pattam on lacond Oaaign Board F 
Conttruct tha pattarn on a Oaaign Board F 

Copy (draw) tha pattarn on a tacond printad 
rapraiamation of tha Oaiign Board F 



Laval C 



Unit 3: A drawing of Oaaign Board Ion 

rubbar banda (ona varticai, ona horliontal, ona 
diagonal) ara rapraaantad . 
Unit 4: A drawing of Oaiign Board I on which thraa 
7 rubbar banda (ona horltontal, ona varticai, 

ona diagonal) ara rapraaantad 



Unit 3: Conttruct tha pattarn on a Oaiign Board I 

Unit 4: Copy (draw) tha P»^°^,™£* , 
prir.ad rapraaantation of Oaaign Board I 



Laval F 



• Unit 3: 

Cf 

Unit 4: 

Unh3: 
Unit 4: 
Unit 5: 



A drawing of Oaaign Board P onj^ thnaa 
rubbar banda (ona varticai, two diagonal) ara 

A*dra*Tn?0T Oaiign Board ^onj^hlch tiiraa 
rubbar banda (ona horlxontal, ona varticai. ona 
otagonoi ) ara rapraaantad 

A drawing of Oaaign Bc^P c^whjchfl^ 
rubbar banda (varticai . horiionnl, diagonal) 

AdrawiMO^Dailgn Board P on which flva 
rubW&S IhorSontai , varticai, diagonal) 



° A nVawino of Oaaign Board P on which foor 
rub^ba^(vw^ 

art rapraaantad 



Unit 3: Conttruct tha pattam on a Oaaign Board P 

Unit 4: Copy(draw)thaoa^ona^nd 

printad rapraaantation of Oaaign Board P 

Unit 3: Conttruct tha pattam on a Datlgn Board P 

Unit 4: Copy (draw) tha pattarr .onj i jiwnd 

printad rapratanation of Oaaign Board P 

UnitB: Copy ^^^•^^ l °^l^^ eti p 
printad* rapraaantation o^iynBoardP 
from which g doti hava baan fadad (PFB) 
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Unit 3: 
^ Unit 4: 
UnitB: 



A <anawJna of Oaaign Board P on which tight 



Adrawing of Oaaign ^^J^^J^\ 
rubbar bandi (horizontal . varticai, diagonal) 



T^JSETofDaaJxi Board P or- which tavan 
(v^jSzon*. diagonal) 



i I 



Unit 4: A drawing of Oaiign *^ *™**%*J*l s 
rubbar bandi (horizontal, varticai . Diagonal) 

, ^ ?^^i?2uDaaion Board P on which tan 
"** ^b^a^«ont.l,d)agon-) 
art rapraaantad 



Unit 3: Conatruct tha pattarn on a Oaiign Board P 

Unit 4: Copy (drawLtna P«^" ^ £™L p 
^ T intad rapraaantation of Oaaign Board p 

UnitB: Copy (draw) tha Prtwnon a 

printad rapraaantation of ST^VSSfai^M 
'ro m which 1B dott hava baan fadad (PF16) 

Unit 4: Copy (draw) tha pattarn on a lacond printad 
rapraaanatiton of Daaign Board P 

Unit «: Copy (draw) tha pattam on a aacond Prlntjd 
napraaantation of Daaign Board P from which 
aii doti hava baan f«*d (PF2S) 
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Objective* of Auditory • Motor Component of the PEP Curriculum 





GIVEN: 




THE CHILD CAN: 


Leva* A 


Unit 1:1 
Unit 2: 

Unit 3: 


March tempo music 
Aserieeof clept 

A series of clip* 


Unit 1: Clep hands in synchrony with tht music 

Unit 2: Ringing from one to four, draw • horizontal desh 

for tact) clap, from lift to right 
Unit 3: Ranging from oni to four, rtproduci thi clipping 

pittirn 



Level B 



Unit 1: 

Unit 2: 

Unit 3: 

Unit 4: 
Unit 5: 



Music with changing ttmpo, dip Unitl:- 
handt in synchrony with thi music 
A swist of long sod short musical Unit 2: 
tonss, ranging from on* to four in total 
A swias of long and short claps, ringing Unit 3: 
from ona to four in total ■ 
A spoken phrsw of numwals . Unit 4: 

A spoksn phrasa of numarais Unit 5: 



Adapting to changas in tampo 

Draw in eppropriete horizontal dash for sach sound, 

from lift to right 

Rtproduci thi clipping patttm 

Clip hands ones for sach word in thi phrasa 
"Write" tha phrasa, using • horizontal dash to repre- 
samaachnumarai (from lift to right), ind raad 
•loud anv numtral on rsquast 



Lav* C 



Unit 4: 
Unit 5: 



Unit 6: 
Unit 7: 



A spoksn phrasa of one-sytlsblt words Unit 4: 
A spoksn phrasa of ona*yllable words Unit 5: 



/A sstfes of spoken one-sylleble words . Unit 6: 

A sarias of spoksn words followsd by Unit 7: 
tha sama sarias from which oni word 
has been omitted 



Clip hands ones for sach word in phrasa 

"Writa" tha phrasa, using • horizontsl dssh torepre- 

ssnt aach word (from lift to right), ind "raad 

■loud iny word raquastad. . • 

Indicati tha prsssnca or absanca of • spacific word 

In that sarias 

Sttta tha omitted word 



Unit 4 : A spokan phrasa of ona- end.two-sy I- Unit 4: 
table words 

Unit 5: A spokan phrasa of ona- ind two-tyl* Units. 
I«blt words 

Unit 6: A spoksn two-sy Habit word Unit 6: 

Unit 7: A tpe*en two«syllibli word followsd Unit 7: 
by a statamsnt of only oni of tha 
ty Habits 

Unit 8: A — oken two- word sarias or com- Unit 8: 
pc*. I twc-tylleble word 



Sty and clip hsnds simultaneously for sach syllabli 
in phrasa 

"Writa" tha phrasa, using • horizontal dash (from ( 

lift to right) to rtprssant aach syllable, ind "rssd 

aloud iny syllabli on rsquast 

Indicate presence or tbstnea of • specified syllable 

in that word ° 

Say the syllable that was omitted 

State single remelning word or sylleble by omitting 
the other es designated 



Leval E 



Unit 4: 
Unit 5: 

Unit 6: 
Unit 7: 

Unit 8: 



A spokan phrase of one-, two-, snd Unit 4: 
thrsa-syilable words . 
A spoksn one-, two-, or three-tylleble Unit 5: 



A spokan three-tyl labia word Unit 6: 

A spoken three-tyl I abut word followed Unit 7: 
by e stetemsnt of only two of the 
syllables 

A spoksn threeiyllebte word Unit 



Sey end clap hands simultaneously for each syllable 
in phrase j . 

"Write'* the word, using e horizontal desh (from 
left to right) to represent eech sylleble. end reed 
eloud enV sylleble on request 
Indicate pressnce or absence of e specified sylleble 
in that word 

Say the sylleble thet was omlttsd 
8: Restets the word omitting e deslgnsted tylleole 



Laval F 



Unit 6: 
Unit 7: 

Unit 8: 



Thrae spoksn words snd e specified ■ Unit 6: 

consonant or vowal sound _ 

A spokan word, followed by e restate- Unit 7 : 

mem of the word with the initial 

consonant sound omi tted 

A spoken word Unit 8: 



Indicate which word begins with thet sound 
Stete the omitted sound 

Repast tha word omitting its initial consonant sound 



Laval Q 



Unit6: 
Unit 7: 



Unit 8: 
Unit 9: 



Three spoken words snd s bps rified Unit 6: 

consonant sound , 

A spoksn word, followed by e restete- Unit 7: 

mem of the word with its f insl;con- 

sonant sound omitted ' 

A spokan word H n t l : 

A spokan word Units: 



Indicate which word ends with thet lound 
Stete the omitted sound 



Ripeat the word omitting its final consonant lound 
Substitute one beginning or ending sound for snother 



Leva* H 



Unit 6: 
Unit 7: 

Unit 8: 
Unit 9: 



Three spoken words snd s specified Unit 6: 

consonant or vowel sound 

A spokan word, followed by e resists- Unit 7: 

ment of the word with one consonant 

sound of e two-consonsnt blend omitttd 

A spoken word Unit 8: 



A spokan word 



* Unit 9: 



Identify which word contains thet sound 
State the omitted lound 



Repeat the word omitting one consonsnt sound of s 
two-consonsnt blend 

Substitute eny consonant or vowel sound forenother 
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Objectives of General • Motor Component of the PEP Curriculum 



GIVEN: 



THE C HILD CAN: 

Stand with on* foot crowed in front of the other for 5 
seconds; then ripNt with othtr foot forward 
Walk forward • distance of 10 f eel with feat crossing ovtr 
in front of aach other 
Jump forward: f aat together 

Qick taath while lips are togathar: mova eyes fr««V to 
far left and far right 
Uta scissors to cut papar 
Identify nsmtd body parts 

Mova only ona arm. than the othar. whila In tupina petition. 
(Angels In Snow poitura) 

Tap right and left hands, alternately, in tempo, run In placa 



Laval A Unit 1 : Varbal instructions 

Unit 2: "- Varbal Instructions 

Unit 3: Varbal instructions 
Unit 4: Varbal instructions 

Unit 5: Varbal instructions 
Unit 6: Varbal instructions 
Unit 7: Verbal instructions 

- Unit 8: Tampo sat by teacher 
and varbal instructions 



Unit 1 : 

Unit 2; 

Unit 3: 
Unit 4: 

Unit 5: 
Unit6: 
Unit 7: 

Unit 8: 



Laval B Unit 1 : Varbal instruction! 

Unit 2: Varbal instructions 

Unit 3: Varbal Instructions 

Unit 4: Varbal Instructions 



Unit 1: 
Unit 2: 



Unit 3: 
Unit 4: 



Unit S: 


Varbal instructions 


Unit 5: 


Unit 6: 
Unit 7: 


Varbal instructions 
Varbal instructions 


Unit 6: 
Unit 7: 


Unit 8: 


Tampo sat by taachar 
ind varbal instructions 


Unit 8: 


Unit 1: 


Varbal instructions 


Unit 1: 


Unit 2: 


Varbal instructions c 


Unit 2: 


Unit 3: 
Unit 4: 


Varbal instructions 
Varbal instructions • 


Unit 3: 
Unit 4: 


Unit 5: 

Unit 6: 
Unit 7: 


A string and varbal 
Instructions 
Varbal instructions 
Varbal instructions 


Unit 5: 

Unit 6: 
Unit 7: 



Balance on ona hand and opposita knaa and foot for 6 
seconds: than repaat with othar hand, knaa and foot 
Hop in place on ona foot, whila supporting self with hands: 
than with othar foot 
Broad lump • 12 Inches 

Mova tongua (Insida mouth) from ona cheek to tha other. 
Mova ayas laterally, looking from own right hand to own 
I aft hind 

Drew a single line connecting two dots thet are tnrae 
inches apart 

Name designated body parts 

Mova one leg, then the other, while in supine position. 

(Angels in Snow posture) 

Tap each hind twice, altarnettng hands while melntalning 
rhythm and tapping pattern 

Stand balanced on ona foot for 8 seconds: then balance on 
ths other foot . 
Hop forward on one foot, e distance of 8 feat; then on the 
other foot ' 
Skip, maintaining synchronous pattern for at least lb feat 
Move tongue end eyes in same direction at same time, upon . 
verbal direction 
Tiea bow 

Name designated body parts (touched but not seen) 
Mova arm and lag on same side simultaneously while in_ 
e supine position: then the other arm and lag (Angals In 
Sw.w posture). Move both hands sumulteneously In the 
same direction to draw a horizontal line: then mova both in 
nnocsita direction . ■-j- 
"" Hop twice, alternatlng'feet while maintaining rhythm end 
hopping pattern 



Unit 8: Tempo sat by taachar 
and varbal instructions 



Mftti Arfoottd from -Adaptive Education for Young Children: The Primary Education Project" by LB! 
(M •&>. rfittd bv M.C. D»y and R.K. P«k.r (Boston: Allyn & Bicon. 1976). 



82 



85 



References 



Deck, I. L. , & Bolvin, J. A model for non-graded ness: The reading 
program for individually prescribed instruction. Elementary 
English . 1967, 46(2), 130-135. Also LRDC Publication Series R44. 

Champagne, D. The Educational Specialist role; A short description . 
Pittsburgh, PA: University of Pittsburgh, Learning Research and 
Development Center, 1971. 

Cooley, W. W. t & Leinhardt, G. The application of a model for 
investigating classroom processes (LRDC Publication 1975/24). 
Pittsburgh, PA: University of Pittsburgh, Learning Research and 
Development Center, 1975. 

Cox, R. C. , \ Boston, M. E. Diagnosis of pupil achievement in the 
individually prescribed instruction project ; Pittsburgh, PA: 
University of Pittsburgh, Learning Research and Development 
Center, 1967. 

Durost, W. H., Bixler, H. H. , Wrightson, J. W. , Prescott, G. A. , & 
Balow, I. H. Metropolitan Achievement Tests . New York, NY: 
Har court, Brace, Jovanovich, 1971. 

Eichelberger, R. R. , 4 Boston, M. E. Follow Through Program final 
sponsor report school year 1973-74 (Vol. I&U). Pittsburgh, 
PA: University of Pittsburgh, Learning Research and Development 
Center, 1976. ; (a) 

Eichelberger, R. T. , & Boston, M. E. The LRDC Follow Through 
Individualized early learning proram . Paper submitted to Follow 
Through for final evaluation report, 1976. (b) 

Gagne, R./ M. The acquisition of knowledge. •' Psychological Review, 
1962, 69, 355-365. 

Gagne, R. M. Learning hierarchies. Educational Psychologist , 1968, 
;6, 1-9. 

General Accounting Office. Follow Through: Lessons learned from its 
evaluation and need to Improve its administration . Report to the 
Congress by the Comptroller General of the United States, 
Washington, D. C, October, 1975. 

Glaser, R. Individuals and learning: The new aptitudes. Educational 
Researcher , 1972, i« 5-13. 

Jastak, J. F., Bijou, S. , W., 4 Jastak, S. R. Wide Range 
Achievement Test . Wilmington, DE: Guidance Associates, 1965. 

Leinhardt, G. The boojum of evaluation: Implementation, some 
measures . Unpublished doctoral dissertation, University of 
Pittsburgh, 1972. 

Leinhardt, G. Observation as a tool for evaluation of implementation , 
instructional Science , 1976, 5, 343-364. 

/ 



/ 



83 



Leinhardt. G. Evaluating an adaptive education program: 
Implementation to replication. Instructional Science. 1977. 6. 
223-257. (a) 

Leinhardt. G. Progrmn evaluation: An «P^°^ nal s ^ ear ° n 
individualized instruction. American Educational Researcn 
Journal . Simmer 1977. H (3). 277-293. (») 

Leinhardt. G. Applying a classroom, process model to instructional 
evaluation. Curriculum Inquiry . 1978. 8 (2), 155-176. 

Lindvall. C. M.. 4 Bolvin. J. 0. The j>roJect for Ig^gH^ 
p rescribed instruction ' (The Oakleaf Project) . Pittsburgh. PA. 
University of Pittsburgh. Learning Research and »««V>JS£n 
Center. 1966. (LRDC Working Paper 8: ERIC Docunent Reproduction 
Service No. ED-010 522) 

Piaget, J. Psychology of intelligence. NewJersty: Littlei.eld. 
Adans (Rep. by arrangement with Humanities Presj) . 1963. 

Raven. J. C. Coloured progressive matrices. London: H. K. Lewis 
and Co., Ltd., 1956. 

Resnick L B. Design of an early, learni ng curriculum. Pittsburgh. 
PA:' Univerlit^f^ittsb^lTeaTning Research and Development 
Center, 1967. (LRDC Working Paper 16) 

Resnick. L. B7. Wang. M. C. . i Kaplan. J. BehavJLor. <gg&* 1| 
. curriculum deign:, A hierarchically, sequenced ^g» ct0 ^ 
mathematic s ^uTrllulun, . Pittsburgh. PA: ""^" lty . ° f 
Pittsburgh. Learning Research and Development Center. 1970. 
(LRDC Publication Series. Monograph 2, 1970). 

Rosner. J. The development and validation of an Individualized 
p erceptual" rirtUa curriculum (LRDC Publication. 1972/7). 
Pittsburgh pir-uSiveTntTol^Plttsburgh, Learning Research and 
£v.££.»t Center. 1972. Also. ERIC Reproduction Service ED 062 
,731. 

Skinner. B. F. Beyond freedom and dignity.. New York. NY: A. A. 
Knopf, 1971. 

Thorndike , R. , Hagan, E. . * Lorge, I. ^^.j*^ ^ 
(Primary I/Fonn I). Boston, MA* Houghton Mifflin, 1968. 

Wang.M. C. The pep testing program . Pittsburgh PA: diversity of 
PittsburghTl^ning Research and Developnent Center, 1969. 

u*«- m r Learning activities and tutoring lessons for the 
'^sAosM^ f^HTiit^cuFFIi^ Pittsburgh PA: 
University of Pittsburgh. Learning Research and Development 
Center, 1972. 

Hang M C. Psychometric studies in the validation of an early 
learning curricula. Child Development . 1973. ««. 51-60. (a) 



84 



87 



Wang, M. C. Teacher's ma nual for the exploratory learning component 
of the classification and communication skills curriculum: Unit 
games (Vol. 1); Commercially- produced games (Vol, 2), 
Pittsburgh, PA: University of Pittsburgh, Learning Research and 
Development Center, 1973- (b) 

Vang, M. C. Teacher's manual for the - exploratory learning component 
of the LRDC Indlv Iduallzed Instruction program for the early 
learning grades: Learning center (Vol* 1); Special projects 
(Vol* 2). Pittsburgh, PA: University of Pittsburgh, Learning 
Research and Development Center, 1973* (c) 

Wang, M. C. The accuracy of teachers' prediction on children's 
learning performance. The Journal of Educational Research , 1973 1 ' 
66 (10) 462-465- (d) 

Wang, M. C. The rationale and design of the Self-Schedule System 
(LRDC Publication, 1974/5"). Pittsburgh, PA: University of 
flttaburgh. Learning Research and Development Center, 1974* 

Wang, M. a. (Ed.) The use of direct observation to study 
instructional learning behaviors in school settings. 
Instructional Science . 1976, 5 365-389. • (a) Also, LRDC 
Publication, 1974/9. 

Wang, M. . C, (Ed.) The self-schedule system for 
Instructional-learning management In adaptive school learning 
n>j environ* ^.s . (LRDC Publication, 1976/9). Pittsburgh, PA: 
University "of Pittsburgh, Learning Research and Development 
Center, 1976. (b) 

Wang, M. C, & Brictson, P. An observational investigation of 
classroom Instructional- learning behaviors under two different 
classroom management systems . Unpublished manuscript. University 
of Pittsburgh, Learning Research and Development' Center; 1973. 

Wang, M. C, Mazza, M. , Haines, J., & Johnson, H. Some measured 
effects of ji classroom management model designed for an 
Individualized early learning curriculum . Paper presented at the 
annual meeting of the American Educational Research Association, 
. - Chicago, April, 1972. 

Wang, M. C, & Resnick, L. B. The primary education program (PEP) . 
Johnstown, PA: Mafex Associates, Inc., 1978. 

Wang, M. C, Resnick, L. B. , & Boozer, R. F. The sequence of 
development of some early mathematics behaviors TLRDC 
Publication, 1971/6). Pittsburgh, PA: University of Pittsburgh, 
Learning Research and Development Center, 1971. 

Wang, M. C, Resnick, L. B. , & Schuetz, P. A. PEP In the Frlck 
elementary school: Interim evaluation report of _the primary 
education project 1968-69 . Pittsburgh, PA: University of 
Pittsburgh, Learning Research and Development Center, 1970. 
CLRDC Working Paper 57). 

Wang, M. C, Resnick, L. B. , & Schuetz, P. R. PEP In the Frlck 



85 




elementary school: Interim evaluation ^1 Jggg (L "5 
Publicatio n,"^^). Mttabjrgh. PA: J"J ve "" y 
Pittsburgh, Learning Research and Development Center, 1971. 

Center, 1975. 

■ -r, r . c tllea B An investigation of children's concept of 
Wang, M. C, & Stiles, B. *n inv« * learning. American 

self-responsibility for their scnooi £ Also. (LRDC 

Educational Research Journal, 1976, 1j(3). 159-179. -uso, 
Publication 1975/11). 



86 



89 



Footnotes 

(1) The research reported herein was supported by the 
Learning Research and Development Center, supported in part by 
the National Institute of Education (NIE) and Project Follow 
Through, the United States Department of -Health, Education, and 
Welfare. The opinions expressed do not necessarily reflect the 
positions or policies of the supporting agencies, and no official 
endorsement should be inferred. 

(2) Many individuals contributed directly to the work 
described in this chapter. The authors would like to especially 
acknowledge, the work of Dr. Lauren Resnick, the original 
developer of the Primary Education Program; Dr. Warren Shepler, 
the first LRDC Follow Through Director, and Dr. Tony 
Elsbelberger, who served as- the LRDC Follow Through Co-Director. 
di-ri:ig the past several years. The authors would also like to 
thank Connie Faddis, Janine Kelley, and Lynne Schorling for their 
lnvaluaole editing and clerical assistance in the preparation or 
this manuscript. 

(3) LRDC was established in 1963 with the overall goal of 
carrying out a program of research and development that would 
lead toward a better understanding and improvement of educational 
practices in the nation's elementary schools. Within LRDC's 
scope of work are projects committed to research and development 
in learning and cognition as they relate to instruction, the 
design of improved instructional practices and classroom 
processes, the development of evaluation and implementation 
methodology, and the assessment of the effectiveness of J*hool 
programs. For over a decade, LRDC has been concerned with 
designing school programs that meet the individual needs of 
students. A basic aim of the individualized instructional model 
developed at LRDC is to provide quality education for all 
children. The main task has been to design pr ograms that are 
flexible and adaptive to a wide range of individual differences 
in children. A number of individualized instructional programs 
hav,e been developed and tested by the LRDC staff and teachers in 

. the collaborating schools. Among these is the Individualized 
Early Learning Program, the program being implemented in the LRDC 
Follow Through sites. LRDC has participated in the National 
Follow Through Program since 1968, and is working with seven 
Follow Through project sites to implement the Individualized 
Early Learning Program. The program is currently being used in 
23 Follow Through elementary schools. 

The Individually Prescribed Instruction tfath Curriculun (IPI 
Math) is published by Appleton-Century-Crofts, New York, NY. The 
Classification and Communication Skills, the Quantification, and 
the Exploratory Learning Curricula are published under the name 
of the Primary Education Program (PEP) by Mafex Associates, Inc., 
Johnstown, PA. The Perceptual Skills Curriculun is published by 
Walker Educational Books Corp., New York, NY. 
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